Commit Graph

  • bdeaa587f9 爬虫列表 陈景阳 2019-09-26 20:52:45 +08:00
  • 5416b7ac60 fix 上传的问题 陈景阳 2019-09-26 19:44:12 +08:00
  • 3845e57612 fix 上传的问题 陈景阳 2019-09-26 19:44:12 +08:00
  • 79ee09aacb 完成爬虫获取 陈景阳 2019-09-26 19:12:02 +08:00
  • 5f158ddb44 完成爬虫获取 陈景阳 2019-09-26 19:12:02 +08:00
  • d27f3c04d6 fix 可能直接退出的问题 陈景阳 2019-09-26 16:49:01 +08:00
  • 169a7d0df9 fix 可能直接退出的问题 陈景阳 2019-09-26 16:49:01 +08:00
  • 6c37731cca 优化爬虫获取逻辑 陈景阳 2019-09-26 16:43:32 +08:00
  • 31be4c1839 优化爬虫获取逻辑 陈景阳 2019-09-26 16:43:32 +08:00
  • 6df6155daf 优化爬虫获取逻辑 陈景阳 2019-09-26 16:26:32 +08:00
  • a11544d809 优化爬虫获取逻辑 陈景阳 2019-09-26 16:26:32 +08:00
  • 475bf4c69e 优化爬虫获取逻辑 陈景阳 2019-09-26 11:38:13 +08:00
  • 947b561653 优化爬虫获取逻辑 陈景阳 2019-09-26 11:38:13 +08:00
  • 9237e62a48 爬虫逻辑修改为从GridFS获取 陈景阳 2019-09-26 11:28:20 +08:00
  • 05c28230b7 爬虫逻辑修改为从GridFS获取 陈景阳 2019-09-26 11:28:20 +08:00
  • c37c0b963b fix 无法终止任务的问题 陈景阳 2019-09-26 10:29:58 +08:00
  • 96e926b486 fix 无法终止任务的问题 陈景阳 2019-09-26 10:29:58 +08:00
  • cde06a0000 fix 无法终止任务的问题 陈景阳 2019-09-26 10:23:08 +08:00
  • e235076a11 fix 无法终止任务的问题 陈景阳 2019-09-26 10:23:08 +08:00
  • 52b7577e0e 添加日志打印 陈景阳 2019-09-26 09:37:10 +08:00
  • 7218a4f4de 添加日志打印 陈景阳 2019-09-26 09:37:10 +08:00
  • 48dcf5a952 添加日志打印 陈景阳 2019-09-25 16:19:58 +08:00
  • fda7e56e1a 添加日志打印 陈景阳 2019-09-25 16:19:58 +08:00
  • 613b5eb139 fix 无法获取task的错误 陈景阳 2019-09-25 15:11:27 +08:00
  • 82999225de fix 无法获取task的错误 陈景阳 2019-09-25 15:11:27 +08:00
  • fe221ffd6f fix 陈景阳 2019-09-25 14:38:46 +08:00
  • 951f6a9f07 fix 陈景阳 2019-09-25 14:38:46 +08:00
  • f3fd19d198 Merge pull request #3 from crawlab-team/develop 暗音 2019-09-25 09:27:15 +08:00
  • 0cb31ad96e Merge pull request #3 from crawlab-team/develop 暗音 2019-09-25 09:27:15 +08:00
  • 0eda5dd9ec Merge pull request #227 from crawlab-team/develop Marvin Zhang 2019-09-18 09:49:40 +08:00
  • c16254a1a9 Merge pull request #227 from crawlab-team/develop Marvin Zhang 2019-09-18 09:49:40 +08:00
  • 3f3c83767a Merge pull request #224 from wo10378931/develop Marvin Zhang 2019-09-10 16:24:10 +08:00
  • a4b69f69a6 Merge pull request #224 from wo10378931/develop Marvin Zhang 2019-09-10 16:24:10 +08:00
  • 7e17adf6b0 fix 空指针引用 陈景阳 2019-09-10 14:47:23 +08:00
  • 3a272b404c fix 空指针引用 陈景阳 2019-09-10 14:47:23 +08:00
  • f20039fefd fix 消息无法订阅问题 fix 可能出现重复爬虫的问题 陈景阳 2019-09-10 14:26:50 +08:00
  • 42e7647cd4 fix 消息无法订阅问题 fix 可能出现重复爬虫的问题 陈景阳 2019-09-10 14:26:50 +08:00
  • 04e13004dd Merge pull request #223 from yaziming/fix-redis-subscrible-failed-problem Marvin Zhang 2019-09-10 13:08:05 +08:00
  • b45b7df6e4 Merge pull request #223 from yaziming/fix-redis-subscrible-failed-problem Marvin Zhang 2019-09-10 13:08:05 +08:00
  • f36e2416c5 fix(all): fix redis subscrible wrong channel yaziming 2019-09-10 12:55:14 +08:00
  • 3976dc568f fix(all): fix redis subscrible wrong channel yaziming 2019-09-10 12:55:14 +08:00
  • 27f36cf91f 删除日志 陈景阳 2019-09-10 09:51:27 +08:00
  • 000b4ff730 删除日志 陈景阳 2019-09-10 09:51:27 +08:00
  • 9514a8a6af 重构msg的包 陈景阳 2019-09-10 09:32:48 +08:00
  • cdeef4b4a5 重构msg的包 陈景阳 2019-09-10 09:32:48 +08:00
  • e5d33b8982 fix 删除spider没有删除task 陈景阳 2019-09-05 20:07:08 +08:00
  • 8cf48d871e fix 删除spider没有删除task 陈景阳 2019-09-05 20:07:08 +08:00
  • 07cd8fb01a Merge pull request #214 from crawlab-team/master Marvin Zhang 2019-09-04 20:57:15 +08:00
  • 2e496964fd Merge pull request #214 from crawlab-team/master Marvin Zhang 2019-09-04 20:57:15 +08:00
  • 35e198b885 Merge pull request #213 from yaziming/forked_master Marvin Zhang 2019-09-04 20:56:16 +08:00
  • 166c49550c Merge pull request #213 from yaziming/forked_master Marvin Zhang 2019-09-04 20:56:16 +08:00
  • 39d8a9ffd5 Merge remote-tracking branch 'forked/develop' into forked_master yaziming 2019-09-04 20:42:01 +08:00
  • 2bd8891889 Merge remote-tracking branch 'forked/develop' into forked_master yaziming 2019-09-04 20:42:01 +08:00
  • 6dc687192e Revert "Revert "V0.4.0 imporve error response"" yaziming 2019-09-04 20:41:37 +08:00
  • 5e2b3ca228 Revert "Revert "V0.4.0 imporve error response"" yaziming 2019-09-04 20:41:37 +08:00
  • eb1a80ec2d added param to task Marvin Zhang 2019-09-04 20:13:28 +08:00
  • 5013233481 added param to task Marvin Zhang 2019-09-04 20:13:28 +08:00
  • 3eee129a7c added param to task Marvin Zhang 2019-09-04 20:13:12 +08:00
  • 4893439ffb added param to task Marvin Zhang 2019-09-04 20:13:12 +08:00
  • 992f3f4d86 Merge pull request #210 from hantmac/develop Marvin Zhang 2019-09-04 14:14:45 +08:00
  • 1b7eea7e57 Merge pull request #210 from hantmac/develop Marvin Zhang 2019-09-04 14:14:45 +08:00
  • fb58cc1a28 bug fix:fix data race caused by LockList hantmac 2019-09-04 13:51:02 +08:00
  • 2fb1754e56 bug fix:fix data race caused by LockList hantmac 2019-09-04 13:51:02 +08:00
  • e93a471e89 Merge pull request #208 from yaziming/v0.4.0-imporve-error-response Marvin Zhang 2019-09-03 15:25:04 +08:00
  • 4e17158a46 Merge pull request #208 from yaziming/v0.4.0-imporve-error-response Marvin Zhang 2019-09-03 15:25:04 +08:00
  • bb4ec17125 Merge pull request #209 from crawlab-team/revert-207-v0.4.0-imporve-error-response Marvin Zhang 2019-09-03 15:24:40 +08:00
  • a5449a674a Merge pull request #209 from crawlab-team/revert-207-v0.4.0-imporve-error-response Marvin Zhang 2019-09-03 15:24:40 +08:00
  • 9744f45e86 Revert "V0.4.0 imporve error response" Marvin Zhang 2019-09-03 15:24:26 +08:00
  • acccdb65bd Revert "V0.4.0 imporve error response" Marvin Zhang 2019-09-03 15:24:26 +08:00
  • 5925011510 Merge pull request #207 from yaziming/v0.4.0-imporve-error-response Marvin Zhang 2019-09-03 15:24:06 +08:00
  • e591986275 Merge pull request #207 from yaziming/v0.4.0-imporve-error-response Marvin Zhang 2019-09-03 15:24:06 +08:00
  • a0df7a4e1e Merge pull request #206 from yaziming/v0.4.0-use-unsafe.pointer-convert-bytes-to-string Marvin Zhang 2019-09-03 15:23:37 +08:00
  • 53cce33d64 Merge pull request #206 from yaziming/v0.4.0-use-unsafe.pointer-convert-bytes-to-string Marvin Zhang 2019-09-03 15:23:37 +08:00
  • 8ee33d3762 feat(backend): add some feat for error message system yaziming 2019-09-03 01:16:36 +08:00
  • 71c83251e5 feat(backend): add some feat for error message system yaziming 2019-09-03 01:16:36 +08:00
  • 888a3cab79 refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions yaziming 2019-09-03 01:07:59 +08:00
  • e10d8fd996 refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions yaziming 2019-09-03 01:07:59 +08:00
  • 208c13c28c Merge pull request #205 from hantmac/develop Marvin Zhang 2019-09-03 13:41:00 +08:00
  • ae9f17716f Merge pull request #205 from hantmac/develop Marvin Zhang 2019-09-03 13:41:00 +08:00
  • 2ffd1774bf bug fix:fix go test ./.. bug hantmac 2019-09-03 12:47:18 +08:00
  • cb3d7263b2 bug fix:fix go test ./.. bug hantmac 2019-09-03 12:47:18 +08:00
  • dff3ffd913 Merge pull request #204 from wo10378931/develop Marvin Zhang 2019-09-03 09:11:46 +08:00
  • 3c244c7306 Merge pull request #204 from wo10378931/develop Marvin Zhang 2019-09-03 09:11:46 +08:00
  • 4255b2f6b6 还原代码 陈景阳 2019-09-03 09:06:04 +08:00
  • cd78e6c745 还原代码 陈景阳 2019-09-03 09:06:04 +08:00
  • 9e9b117669 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop 陈景阳 2019-09-03 08:57:21 +08:00
  • eb92d34f9b Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop 陈景阳 2019-09-03 08:57:21 +08:00
  • f514bed59d Merge pull request #203 from yaziming/v0.4.0-mongo-redis-support-timeout-and-pool Marvin Zhang 2019-09-03 08:19:22 +08:00
  • ce08411960 Merge pull request #203 from yaziming/v0.4.0-mongo-redis-support-timeout-and-pool Marvin Zhang 2019-09-03 08:19:22 +08:00
  • ec328ae02b Remove redundant fmt.Println yaziming 2019-09-02 22:57:29 +08:00
  • 361134f8dd Remove redundant fmt.Println yaziming 2019-09-02 22:57:29 +08:00
  • 6675d075f2 fix 删除spider没有删除task的问题 陈景阳 2019-09-02 20:49:00 +08:00
  • 352fac4096 fix 删除spider没有删除task的问题 陈景阳 2019-09-02 20:49:00 +08:00
  • 2b579cc642 break loop when subscribe count is 0 yaziming 2019-09-02 18:32:47 +08:00
  • 10c3488caf break loop when subscribe count is 0 yaziming 2019-09-02 18:32:47 +08:00
  • 41c3b98333 还原代码 陈景阳 2019-09-02 18:14:34 +08:00
  • b5084c964b 还原代码 陈景阳 2019-09-02 18:14:34 +08:00
  • 45aaaa2c46 fix 无法正常删除有问题的爬虫 陈景阳 2019-09-02 18:04:47 +08:00
  • 8b237ddc2a fix 无法正常删除有问题的爬虫 陈景阳 2019-09-02 18:04:47 +08:00
  • 69fc10fcc3 fix 如果从dir读取爬虫为空,则移除所有的爬虫 陈景阳 2019-09-02 17:37:48 +08:00