Commit Graph

Select branches

Hide Pull Requests

dependabot/go_modules/backend/github.com/sirupsen/logrus-1.9.1

dependabot/go_modules/backend/golang.org/x/crypto-0.45.0

dependabot/go_modules/core/golang.org/x/crypto-0.45.0

develop

main

test

#100

#1001

#101

#1011

#1018

#102

#1023

#1024

#1025

#1027

#103

#1030

#1033

#1034

#1035

#1036

#1043

#1045

#105

#1050

#1051

#1052

#1058

#1059

#106

#1060

#1064

#1065

#1066

#1067

#1069

#107

#1071

#1072

#1078

#108

#1085

#109

#1091

#1096

#1097

#1098

#1099

#1100

#1101

#1109

#1115

#1117

#1119

#1122

#1124

#1127

#1145

#1146

#1148

#1157

#116

#1165

#1169

#1170

#118

#1185

#119

#1191

#120

#1205

#1208

#1211

#1216

#1227

#1229

#123

#1230

#1239

#124

#1240

#1241

#1245

#1249

#1250

#1256

#1269

#127

#1276

#128

#1282

#1283

#1284

#1285

#1286

#1287

#1289

#129

#1290

#1291

#13

#130

#1303

#1305

#1308

#1311

#1313

#1317

#1318

#132

#1320

#1323

#1324

#1327

#1329

#133

#1330

#1332

#1334

#134

#1341

#1342

#1343

#1344

#1345

#1346

#135

#1351

#1352

#1355

#1357

#1359

#136

#1360

#1369

#1374

#1375

#1376

#1378

#138

#14

#140

#1400

#1404

#141

#1410

#1413

#1419

#142

#1429

#1431

#1435

#1438

#1439

#144

#1447

#1448

#1449

#145

#1450

#1452

#1456

#1459

#146

#147

#148

#1481

#149

#15

#1501

#1509

#151

#1510

#1519

#153

#1530

#1533

#154

#1542

#1544

#155

#1553

#1555

#1557

#1558

#1564

#1565

#1566

#1568

#1574

#1578

#1579

#158

#1599

#160

#1602

#1605

#1606

#1608

#1612

#1612

#1613

#1613

#1615

#1615

#162

#163

#164

#165

#166

#167

#168

#169

#170

#173

#175

#176

#179

#18

#187

#189

#19

#190

#191

#192

#193

#194

#195

#197

#198

#20

#201

#203

#204

#205

#206

#207

#208

#209

#210

#212

#213

#214

#22

#223

#224

#227

#23

#232

#233

#234

#235

#236

#237

#238

#24

#241

#242

#243

#245

#246

#247

#248

#25

#254

#259

#26

#268

#275

#276

#277

#278

#279

#28

#280

#281

#282

#283

#284

#29

#290

#291

#292

#294

#298

#300

#309

#313

#320

#321

#322

#324

#328

#329

#33

#330

#331

#332

#333

#336

#337

#339

#343

#344

#345

#347

#350

#352

#355

#356

#359

#361

#362

#363

#364

#365

#366

#367

#368

#369

#370

#374

#376

#377

#378

#381

#382

#389

#39

#394

#395

#397

#399

#40

#400

#405

#409

#41

#410

#411

#414

#415

#416

#420

#422

#43

#430

#431

#432

#433

#434

#437

#438

#44

#440

#442

#443

#444

#445

#446

#447

#448

#449

#457

#459

#46

#460

#463

#464

#468

#469

#47

#471

#472

#473

#475

#476

#477

#478

#48

#483

#484

#486

#487

#489

#49

#490

#491

#492

#493

#494

#495

#496

#497

#498

#499

#50

#500

#501

#502

#503

#504

#506

#507

#508

#509

#510

#511

#512

#513

#516

#517

#518

#52

#520

#521

#522

#523

#525

#526

#528

#529

#53

#530

#531

#532

#533

#534

#535

#536

#537

#538

#539

#540

#541

#542

#543

#544

#545

#547

#548

#549

#55

#550

#551

#552

#553

#554

#555

#556

#557

#558

#569

#573

#574

#575

#576

#581

#582

#585

#586

#587

#588

#589

#590

#591

#592

#593

#594

#595

#60

#602

#604

#605

#606

#607

#61

#612

#615

#617

#618

#62

#625

#626

#627

#628

#629

#63

#630

#631

#632

#633

#634

#635

#636

#641

#65

#66

#661

#662

#663

#664

#67

#682

#685

#686

#695

#696

#701

#708

#71

#710

#713

#714

#715

#716

#72

#722

#723

#724

#727

#73

#733

#735

#736

#738

#741

#743

#744

#745

#748

#749

#75

#757

#759

#76

#762

#763

#767

#77

#780

#789

#79

#791

#792

#801

#803

#804

#805

#806

#818

#825

#84

#846

#85

#86

#860

#861

#862

#867

#868

#870

#872

#873

#875

#876

#88

#884

#885

#89

#890

#891

#896

#90

#91

#918

#92

#94

#940

#943

#945

#95

#950

#951

#952

#955

#959

#96

#961

#963

#969

#97

#971

#976

#977

#978

#979

#98

#980

#981

#982

#983

#984

#985

#986

#987

#988

#989

#996

v0.1

v0.1.1

v0.2

v0.2.1

v0.2.2

v0.2.3

v0.2.4

v0.3.0

v0.3.1

v0.3.2

v0.3.3

v0.3.4

v0.3.5

v0.4.0

v0.4.1

v0.4.10

v0.4.2

v0.4.3

v0.4.4

v0.4.5

v0.4.6

v0.4.7

v0.4.8

v0.4.9

v0.5.0

v0.5.1

v0.6.0

v0.6.0-1

v0.6.0-beta.20210803

v0.6.0-beta.20211120

v0.6.0-beta.20211224

v0.6.1

v0.6.2

v0.6.3

v0.6.3-dev

Mono Color

• 5d0c8c580e chore(deps): bump github.com/sirupsen/logrus in /backend dependabot/go_modules/backend/github.com/sirupsen/logrus-1.9.1 dependabot[bot] 2025-12-05 02:36:48 +00:00
• ee11cd78ec test: add unit tests for IgnoreFileRegexPattern to validate ignored paths develop Marvin Zhang 2025-12-03 15:45:41 +08:00
• aba7be3b86 fix: update IgnoreFileRegexPattern to exclude .git directory Marvin Zhang 2025-12-03 15:45:18 +08:00
• 034fbf1a84 fix(git): include path parameter in listDir dispatch for directory listing Marvin Zhang 2025-12-03 15:39:03 +08:00
• 6085ed0db0 fix(git): update listDir dispatch to include path parameter Marvin Zhang 2025-12-02 17:05:22 +08:00
• b2ff8baed8 fix(spider): update node selection to use active nodes instead of all nodes fix(spider): optimize form update logic to watch specific fields for changes fix(grpc): adjust sync request ID handling for git and regular spiders Marvin Zhang 2025-12-02 11:42:29 +08:00
• 0135e2ee3b chore(deps): bump golang.org/x/crypto from 0.25.0 to 0.45.0 in /core dependabot/go_modules/core/golang.org/x/crypto-0.45.0 dependabot[bot] 2025-11-20 00:54:27 +00:00
• 6c8bd84a0d chore(deps): bump golang.org/x/crypto from 0.23.0 to 0.45.0 in /backend dependabot/go_modules/backend/golang.org/x/crypto-0.45.0 dependabot[bot] 2025-11-20 00:44:01 +00:00
• 97ab39119c feat(specs): add detailed documentation for gRPC file sync migration and release 0.7.0 Marvin Zhang 2025-11-10 14:07:36 +08:00
• 18c5eb3956 fix: replace string slicing with filepath.Dir() in gRPC file sync Marvin Zhang 2025-10-30 15:22:53 +08:00
• bd99899182 fix(core): default to _id descending sort when sort is nil or parsing fails Marvin Zhang 2025-10-28 11:55:00 +08:00
• 851097dc59 fix(node/service): implement worker client wrapper using local TaskServiceServer Marvin Zhang 2025-10-27 16:26:32 +08:00
• b8e62c7b6b fix(node/master): add failure counter and grace period to node health checks; increase monitor interval Marvin Zhang 2025-10-23 14:49:30 +08:00
• ef70312430 fix(grpc/server): add keepalive enforcement and params to match client Marvin Zhang 2025-10-23 10:58:22 +08:00
• 893cb3cb8a fix(grpc/server): mark node active on Subscribe and notify on status change Marvin Zhang 2025-10-22 22:03:16 +08:00
• 18fc84afb7 fix(grpc/client): clear reconnecting on failure and requeue reconnection after backoff Marvin Zhang 2025-10-21 22:03:17 +08:00
• 138bed5c05 fix(grpc/client): wait for full reconnection readiness before clearing reconnecting flag Marvin Zhang 2025-10-21 21:26:57 +08:00
• ba6d989c7e fix(controllers/health): return after responding OK to avoid falling through; tidy imports Marvin Zhang 2025-10-20 16:34:55 +08:00
• ec3dd2d077 fix(grpc/client): protect GetGrpcClient with _clientMux lock to avoid race during singleton init Marvin Zhang 2025-10-20 13:43:55 +08:00
• 2dfc66743b fix(grpc/client,node/task/handler): add RetryWithBackoff, stabilize reconnection, and retry gRPC ops Marvin Zhang 2025-10-20 13:01:10 +08:00
• f441265cc2 feat(sync): add gRPC file synchronization service and integrate end-to-end Marvin Zhang 2025-10-20 12:48:53 +08:00
• 61604e1817 fix(task/handler): ensure latest gRPC client is used for task fetch/subscribe Marvin Zhang 2025-10-20 12:22:34 +08:00
• 4baa5fad59 fix(grpc/client): trigger reconnection on bad conn state and improve connection logging Marvin Zhang 2025-10-20 11:34:41 +08:00
• 6020fef30b chore(node): add timing logs and improve node status diagnostics Marvin Zhang 2025-10-20 11:14:55 +08:00
• 49165b2165 refactor(node): reorganize task reconciliation, prioritize worker cache, add periodic cleanup Marvin Zhang 2025-10-20 10:54:32 +08:00
• 7cbe17723d Merge pull request #1606 from crawlab-team/develop test Marvin Zhang 2025-10-09 12:43:38 +08:00
• 883c954b4e feat: update Dockerfile to include 'go mod tidy' before installation Marvin Zhang 2025-10-09 12:39:12 +08:00
• 44fd0809e6 feat: disable backend unit tests and document reasons for integration test requirements Marvin Zhang 2025-10-09 12:35:09 +08:00
• 5bff8823a8 feat: update test workflows to skip API tests and document controller test status Marvin Zhang 2025-10-09 11:34:26 +08:00
• 5a0a640900 Merge pull request #1605 from crawlab-team/develop Marvin Zhang 2025-10-09 11:17:07 +08:00
• 2a211923da Update core/task/handler/runner_sync.go Marvin Zhang 2025-10-09 11:14:32 +08:00
• 587d9d0960 Merge branch 'test' into develop Marvin Zhang 2025-10-09 11:13:51 +08:00
• 4c508557e7 feat: parameterize ports in Docker Compose for better configurability Marvin Zhang 2025-09-29 14:31:33 +08:00
• 29ef8d67da feat: implement synchronization and error handling improvements in task reconciliation and file synchronization Marvin Zhang 2025-09-28 17:42:23 +08:00
• e80256aa61 feat: add support for Chinese locale in Docker setup Marvin Zhang 2025-09-17 16:00:27 +08:00
• b6e14a13fe refactor: remove obsolete task reconciliation service tests Marvin Zhang 2025-09-17 11:05:27 +08:00
• afa5fab4c1 feat: enhance task reconciliation with worker-side status caching and synchronization Marvin Zhang 2025-09-17 11:03:35 +08:00
• 8c2c23d9b6 feat: Update gRPC service definitions and implement CheckProcess method Marvin Zhang 2025-09-17 10:37:03 +08:00
• c6834e9964 feat: enhance task reconciliation logic with improved status handling and error messaging Marvin Zhang 2025-09-17 10:18:13 +08:00
• 8ebdd98f99 feat: enhance ORM functionality with toggle support and UI updates Marvin Zhang 2025-09-16 16:09:33 +08:00
• bfe40e7c67 fix: comment out AI Assistant toggle button in Header.vue Marvin Zhang 2025-09-16 15:45:56 +08:00
• 39f83d71b1 fix: update NotificationRequestDTO to include BSON field names for setting and channel Marvin Zhang 2025-09-16 15:43:43 +08:00
• 196273c423 feat: implement ORM support with toggle functionality and UI updates Marvin Zhang 2025-09-16 15:18:35 +08:00
• 875ca290b5 fix: update UseORM description to specify supported databases (MySQL, PostgreSQL, SQL Server) Marvin Zhang 2025-09-16 14:04:01 +08:00
• 293e630f6f feat: add UseORM field to Database struct for ORM support Marvin Zhang 2025-09-16 13:30:50 +08:00
• 8450b074c0 fix: comment out unused 'models' menu item in SystemDetail.vue Marvin Zhang 2025-09-16 09:33:15 +08:00
• 56277e47be fix: remove unused build scripts to streamline the build process Marvin Zhang 2025-09-16 09:32:23 +08:00
• 9ade564d0a Remove unused TypeScript declaration files for task, token, and user components in the Crawlab UI, streamlining the codebase and improving maintainability. Marvin Zhang 2025-09-16 09:31:34 +08:00
• 7d1a61581e feat: add support for multi-architecture Docker builds with configurable input Marvin Zhang 2025-09-14 16:39:29 +08:00
• 72177b2728 fix: update node disconnected status styling and behavior Marvin Zhang 2025-09-14 15:20:01 +08:00
• 437c30b699 fix: ensure worker services depend on healthy master service Marvin Zhang 2025-09-14 15:02:06 +08:00
• 829fcac3ff feat: add multi-platform support for Docker builds Marvin Zhang 2025-09-14 14:49:53 +08:00
• 7c33fec784 refactor: remove unused fields from WorkerService struct Marvin Zhang 2025-09-12 18:17:36 +08:00
• e221e3c640 feat: enhance gRPC client handling with improved reconnection logic and monitoring Marvin Zhang 2025-09-12 18:16:52 +08:00
• 07bb7f8ba9 fix: enhance node metrics handling by checking state before accessing metrics map Marvin Zhang 2025-09-12 16:34:40 +08:00
• 316878e129 test: add comprehensive tests for task reconciliation service handling offline nodes Marvin Zhang 2025-09-12 16:10:00 +08:00
• 60be5072e5 feat: add node disconnection handling and update task statuses accordingly Marvin Zhang 2025-09-12 15:40:29 +08:00
• 05a71da26e refactor: comment out AI chat features in NormalLayout.vue for future implementation Marvin Zhang 2025-09-12 15:01:29 +08:00
• b5f10cb6a8 feat: add TypeScript interfaces for Vuex store modules Marvin Zhang 2025-09-12 14:57:42 +08:00
• 14a94ff798 refactor: enhance error logging in writeLogLines to respect circuit breaker state Marvin Zhang 2025-09-12 14:34:27 +08:00
• c0e230e5d8 refactor: rename PING code to HEARTBEAT in node service and update related proto files Marvin Zhang 2025-09-12 14:17:49 +08:00
• d39c265483 feat: add PING message handling for connection health checks Marvin Zhang 2025-09-12 13:58:16 +08:00
• 333dfd44c0 refactor: implement circuit breaker for log connections to prevent flooding during failures Marvin Zhang 2025-09-12 13:55:44 +08:00
• 3edd2a1210 refactor: optimize connection health checks to reduce log stream interference; adjust health check intervals and implement non-blocking pings Marvin Zhang 2025-08-16 17:42:07 +08:00
• 65aeb3ed8c feat: add PING mechanism for connection health checks; update proto and generated files - Introduced PING code in TaskServiceConnectCode enum for health checks. - Updated Runner to use proper PING messages instead of fake log messages for connection health checks. - Modified TaskServiceServer to handle PING requests and acknowledge them. - Adjusted generated gRPC files to reflect changes in proto definitions and ensure compatibility. Marvin Zhang 2025-08-16 17:19:21 +08:00
• babecc46c0 refactor: update DependencySetupDialog to use language key for tag label; modify useDependencyList to dispatch node retrieval on mount Marvin Zhang 2025-08-08 11:12:05 +08:00
• 45913ad7e4 refactor: implement health service for master and worker nodes; add health check script and integrate health checks into service lifecycle Marvin Zhang 2025-08-08 00:05:00 +08:00
• 78f9e0ca8d refactor: update task worker pool to support dynamic max workers and improve queue management; enhance configuration defaults for node runners and task queue size Marvin Zhang 2025-08-07 18:16:23 +08:00
• 6340a9b880 refactor: Move context initialization for graceful shutdown to appropriate locations Marvin Zhang 2025-08-07 17:27:11 +08:00
• 6912b92501 refactor: enhance context handling across task runner and service components; ensure proper cancellation chains and prevent goroutine leaks Marvin Zhang 2025-08-07 15:40:48 +08:00
• e1251d808b refactor: update method receivers to value type for cleanup and connection methods; enhance context usage for task client operations Marvin Zhang 2025-08-07 11:53:42 +08:00
• f5f83a010f refactor: update metric list structure for improved layout and responsiveness; enhance styling with grid display Marvin Zhang 2025-08-07 11:12:50 +08:00
• d042bc8cd7 refactor: improve connection readiness check and enhance goroutine management in gRPC client; ensure proper context handling in stream listeners Marvin Zhang 2025-08-07 11:12:46 +08:00
• 060396af3d refactor: enhance data structure annotations and improve layout responsiveness in Home component Marvin Zhang 2025-08-07 09:58:11 +08:00
• 44dd68918f refactor: improve goroutine management and context handling in task and stream operations; ensure graceful shutdown and prevent leaks Marvin Zhang 2025-08-07 00:16:46 +08:00
• 784ffc8b52 feat: implement task management service operations, stream manager, and worker pool Marvin Zhang 2025-08-06 18:29:08 +08:00
• 3678d14082 feat: implement bounded goroutine pools for task execution and notification handling; enhance task scheduler with graceful shutdown and cleanup routines; update metric component for new time range options Marvin Zhang 2025-08-06 17:57:37 +08:00
• 9745129e33 feat: configure test database as master node for testing Marvin Zhang 2025-07-23 15:28:51 +08:00
• cf5ec81250 fix: add nil checks for logger in config initialization and logging methods Marvin Zhang 2025-07-23 15:07:39 +08:00
• a2d13fae36 feat: temporarily disable batch file saving route and implement alternative handler in spider controller Marvin Zhang 2025-07-23 14:55:04 +08:00
• b4288b08a5 fix: Update FsFileInfo to use pointer slices for children and remove redundant getter methods Marvin Zhang 2025-07-23 09:42:07 +08:00
• 3c3ff09723 feat: enhance gRPC client with health check functionality and improved connection handling Marvin Zhang 2025-07-09 14:38:53 +08:00
• 20ba390cf6 refactor: improve mongo client connection error logging format and remove redundant gRPC server start in MasterService Marvin Zhang 2025-07-09 14:06:10 +08:00
• 46c0cd6298 refactor: update gRPC client access patterns to use safe getter methods for improved error handling Marvin Zhang 2025-07-08 18:08:46 +08:00
• 8bd3ef0b72 feat: add goroutine count metric to the MetricService and update related files Marvin Zhang 2025-07-08 14:08:31 +08:00
• 7e4187f388 chore: add TypeScript declaration files for various components and services Marvin Zhang 2025-07-08 14:08:13 +08:00
• 00daa0ed96 fix: enhance gRPC client reconnection logic and add goroutine monitoring for potential leaks Marvin Zhang 2025-07-08 13:39:39 +08:00
• f8e9c45a85 fix: enhance gRPC client connection management with circuit breaker and keep-alive settings Marvin Zhang 2025-07-08 13:34:43 +08:00
• 92046a8c2e fix: improve task cancellation and connection health check logic with timeout handling Marvin Zhang 2025-06-27 14:02:24 +08:00
• 9f251f3ebe fix: enhance task cancellation logic with graceful termination and stuck task cleanup Marvin Zhang 2025-06-27 13:50:21 +08:00
• 89514b0154 feat: implement zombie process prevention and cleanup mechanisms in task runner Marvin Zhang 2025-06-23 13:54:43 +08:00
• 1008886715 fix: enhance task service resilience with connection health monitoring and periodic cleanup Marvin Zhang 2025-06-23 11:57:05 +08:00
• 682efa807d ci: add version check before publishing to NPM and provide publish summary Marvin Zhang 2025-06-20 17:53:15 +08:00
• 5837472de5 fix: update API client constructor and improve error handling for missing API token and URL chore: update package version to 0.1.1-dev.6 and adjust dependencies in pnpm-lock.yaml refactor: change import paths to relative in tools.ts for consistency Marvin Zhang 2025-06-20 15:55:50 +08:00
• 99d59b8e90 chore: add publishConfig to package.json for public access Marvin Zhang 2025-06-20 15:00:16 +08:00
• 18137cce0d fix: update jest test command to allow passing with no tests Marvin Zhang 2025-06-20 14:58:12 +08:00
• b7b7f25451 refactor: remove unused response variables in database, git, node, project, schedule, spider, task modules Marvin Zhang 2025-06-20 14:55:54 +08:00
• 4f33460d45 chore: remove .gitattributes file to simplify language detection Marvin Zhang 2025-06-20 14:45:22 +08:00
• 13038d4a1a fix: unable to sync files from master in worker nodes Marvin Zhang 2025-06-20 14:42:52 +08:00
• 52b180aaa0 ci: Add GitHub Actions workflow for publishing MCP package Marvin Zhang 2025-06-20 11:09:02 +08:00