Commit Graph

1020 Commits

Author SHA1 Message Date
陈景阳
6fb831b322 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-12-07 10:58:24 +08:00
陈景阳
d7877ee45e 添加注释 2019-12-07 10:58:09 +08:00
暗音
81f229736c Merge pull request #15 from crawlab-team/develop
Develop
2019-12-07 10:56:04 +08:00
marvzhang
867e8d1404 Merge remote-tracking branch 'origin/develop' into develop 2019-12-06 17:59:55 +08:00
marvzhang
70c23c3a45 强制在运行之前保存爬虫 2019-12-06 15:57:42 +08:00
Marvin Zhang
0c2b7c54e4 Merge pull request #350 from hantmac/develop
支持批量删除、筛选指定状态的任务
2019-12-06 11:06:08 +08:00
hantmac
4bf72c9df1 新增authGroup.DELETE(/tasks_by_status, routes.DeleteTaskByStatus) 支持批量删除指定状态的任务 2019-12-06 10:08:45 +08:00
marvzhang
54118c40b0 remove workflow 2019-12-05 19:49:36 +08:00
marvzhang
f24e1e1d5c remove docs 2019-12-05 19:48:01 +08:00
hantmac
a74fd82b6a - 新增authGroup.DELETE("/tasks_by_status", routes.DeleteTaskByStatus) 支持批量删除指定状态的任务
- TaskListRequestData中增加Status字段,支持根据task状态进行筛选
2019-12-05 15:12:32 +08:00
marvzhang
7362b253e3 updated workflow 2019-12-05 12:12:12 +08:00
marvzhang
d186d6b11c Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop 2019-12-05 12:09:41 +08:00
Marvin Zhang
d2f650fb71 Merge pull request #345 from crawlab-team/master
Master
2019-12-05 12:09:08 +08:00
Marvin Zhang
3b66e3ed49 Create nodejs.yml 2019-12-05 12:07:20 +08:00
marvzhang
6c93a8d596 rename documentation 2019-12-05 12:06:38 +08:00
marvzhang
01355ecba9 rename documentation 2019-12-05 12:06:28 +08:00
marvzhang
2549e87bd2 added documents 2019-12-05 12:02:10 +08:00
Marvin Zhang
062bc9243f Merge pull request #344 from crawlab-team/develop
Develop
2019-12-05 11:56:17 +08:00
Marvin Zhang
8b9543365f Merge pull request #343 from crawlab-team/develop
Develop
2019-12-05 11:55:43 +08:00
marvzhang
f5bf36ef49 Merge remote-tracking branch 'origin/develop' into develop 2019-12-05 11:52:08 +08:00
marvzhang
f8cf5b3241 添加运行类别 2019-12-05 11:51:54 +08:00
陈景阳
0c5ae35297 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-12-05 07:18:17 +08:00
暗音
d585785c74 Merge pull request #339 from wo10378931/develop
Develop
2019-12-05 07:15:52 +08:00
陈景阳
026c9756b9 Merge remote-tracking branch 'upstream/develop' into develop 2019-12-05 07:15:07 +08:00
Marvin Zhang
6012a49623 Merge pull request #337 from hantmac/develop
修改isDeletePeriodically参数默认为N
2019-12-04 16:57:03 +08:00
hantmac
5bb8be1ddd fix 2019-12-04 16:48:36 +08:00
hantmac
88a22097da 修改isDeletePeriodically参数默认为N 2019-12-04 16:46:16 +08:00
Marvin Zhang
efbd6caee3 Merge pull request #336 from crawlab-team/develop
Develop
2019-12-04 16:42:34 +08:00
marvzhang
82c7cd63b7 优化 https://github.com/crawlab-team/crawlab/issues/185 2019-12-04 16:33:02 +08:00
marvzhang
50b53b9ed4 优化可配置爬虫可视化:Tooltip信息 2019-12-04 15:34:41 +08:00
marvzhang
2d5c5952ee 优化可配置爬虫可视化:顺序排列 2019-12-04 15:26:56 +08:00
marvzhang
c73990d19c 优化可配置爬虫可视化:顺序排列 2019-12-04 15:26:06 +08:00
marvzhang
514afa05b4 当stage被删除时,重置next_stage被设置为该stage的field 2019-12-04 15:03:22 +08:00
marvzhang
97ca3b74b8 修复爬虫被覆盖的问题 2019-12-04 14:54:49 +08:00
marvzhang
be4a5f6667 优先调整xpath顺序 2019-12-04 13:57:27 +08:00
marvzhang
82c6b80063 更新Spiderfile模版 2019-12-03 14:25:54 +08:00
marvzhang
589190d674 加入Spiderfile模版 2019-12-03 13:37:41 +08:00
marvzhang
9c5c0bd270 更新可配置爬虫 2019-12-03 12:14:38 +08:00
marvzhang
af680d576a 更新可配置爬虫 2019-12-02 22:35:45 +08:00
marvzhang
fd27949a40 加入依赖模块 2019-12-02 17:46:57 +08:00
marvzhang
c237c0cf96 Merge remote-tracking branch 'origin/develop' into develop 2019-12-02 13:32:44 +08:00
marvzhang
8eafbf480c 完成可配置爬虫设置部分 2019-12-02 13:29:00 +08:00
marvzhang
8f3a1f12f5 加入可配置爬虫设置页面 2019-12-02 12:43:44 +08:00
Marvin Zhang
ebbb7b78ef Merge pull request #333 from hantmac/develop
Add return
2019-12-02 11:37:41 +08:00
hantmac
3992eebb16 Merge remote-tracking branch 'crawlab-team/develop' into develop 2019-12-02 11:19:00 +08:00
hantmac
67ae278a66 fix 2019-12-02 11:14:15 +08:00
Marvin Zhang
7a61e74148 Merge pull request #332 from hantmac/develop
fix panic because of interface{} is nil
2019-12-02 10:44:27 +08:00
hantmac
d1ba010700 Merge remote-tracking branch 'crawlab-team/develop' into develop 2019-12-02 10:18:48 +08:00
hantmac
8f06646d99 fix panic because of interface{} is nil 2019-12-02 10:11:57 +08:00
Marvin Zhang
8c4161c7f6 Merge pull request #324 from hantmac/develop
bug fix:修复手动或者自动删除日志后的报错
2019-12-02 09:22:29 +08:00