Commit Graph

260 Commits

Author SHA1 Message Date
marvzhang
44c9bde96f fixed https://github.com/crawlab-team/crawlab/issues/373 2019-12-19 10:42:20 +08:00
Marvin Zhang
32c07c5270 Merge pull request #370 from wo10378931/develop
Develop
2019-12-17 10:09:37 +08:00
陈景阳
232c299949 去掉select 语句的break关键字 2019-12-17 10:07:38 +08:00
hantmac
7fff86feb1 Update test cases 2019-12-15 09:18:13 +08:00
marvzhang
3ef794f7a2 将可配置爬虫stages调整为列表 2019-12-13 12:55:53 +08:00
陈景阳
c64ea5c250 优化代码,添加注释 2019-12-12 20:52:09 +08:00
marvzhang
0cf745767c 修复定时任务不一致问题 2019-12-12 13:13:42 +08:00
陈景阳
728dbd5147 fix 同步锁可能异常的情况 2019-12-10 09:22:09 +08:00
陈景阳
68324d2ec5 fix 错误信息的返回 2019-12-09 11:23:30 +08:00
陈景阳
b4c160fe22 完成可能重复注册节点的问题 2019-12-09 10:28:48 +08:00
陈景阳
0daeb33699 完成批量删除Task任务列表 2019-12-08 10:58:02 +08:00
陈景阳
6e7634d70f Feature 新增定时任务可暂停/运行 2019-12-07 14:02:54 +08:00
陈景阳
6fb831b322 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-12-07 10:58:24 +08:00
hantmac
4bf72c9df1 新增authGroup.DELETE(/tasks_by_status, routes.DeleteTaskByStatus) 支持批量删除指定状态的任务 2019-12-06 10:08:45 +08:00
hantmac
a74fd82b6a - 新增authGroup.DELETE("/tasks_by_status", routes.DeleteTaskByStatus) 支持批量删除指定状态的任务
- TaskListRequestData中增加Status字段,支持根据task状态进行筛选
2019-12-05 15:12:32 +08:00
marvzhang
f5bf36ef49 Merge remote-tracking branch 'origin/develop' into develop 2019-12-05 11:52:08 +08:00
marvzhang
f8cf5b3241 添加运行类别 2019-12-05 11:51:54 +08:00
陈景阳
0c5ae35297 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-12-05 07:18:17 +08:00
陈景阳
026c9756b9 Merge remote-tracking branch 'upstream/develop' into develop 2019-12-05 07:15:07 +08:00
hantmac
5bb8be1ddd fix 2019-12-04 16:48:36 +08:00
hantmac
88a22097da 修改isDeletePeriodically参数默认为N 2019-12-04 16:46:16 +08:00
marvzhang
97ca3b74b8 修复爬虫被覆盖的问题 2019-12-04 14:54:49 +08:00
marvzhang
be4a5f6667 优先调整xpath顺序 2019-12-04 13:57:27 +08:00
marvzhang
82c6b80063 更新Spiderfile模版 2019-12-03 14:25:54 +08:00
marvzhang
589190d674 加入Spiderfile模版 2019-12-03 13:37:41 +08:00
marvzhang
9c5c0bd270 更新可配置爬虫 2019-12-03 12:14:38 +08:00
marvzhang
af680d576a 更新可配置爬虫 2019-12-02 22:35:45 +08:00
marvzhang
fd27949a40 加入依赖模块 2019-12-02 17:46:57 +08:00
marvzhang
c237c0cf96 Merge remote-tracking branch 'origin/develop' into develop 2019-12-02 13:32:44 +08:00
hantmac
67ae278a66 fix 2019-12-02 11:14:15 +08:00
hantmac
8f06646d99 fix panic because of interface{} is nil 2019-12-02 10:11:57 +08:00
hantmac
5e846209d6 Merge remote-tracking branch 'crawlab-team/develop' into develop 2019-12-01 18:36:22 +08:00
Jeremy
578dcac22b Merge pull request #330 from appleboy/patch-3
chore: fix fmt warning.
2019-12-01 18:29:42 +08:00
Bo-Yi Wu
1283e0483f chore: fix fmt warning. 2019-12-01 18:16:39 +08:00
marvzhang
08c7aec49c 加入可配置爬虫阶段设置 2019-11-30 10:58:54 +08:00
hantmac
61daf732bd bug fix:修复手动或者自动删除日志后的报错 2019-11-29 13:52:03 +08:00
marvzhang
a1bfe00eee 准备可配置爬虫自定义设置变量 2019-11-29 13:42:50 +08:00
marvzhang
e14c7fa80e 修复删除可配置爬虫问题 2019-11-28 22:20:20 +08:00
marvzhang
ba4f5fd20c 优化可配置爬虫前端界面 2019-11-28 21:36:17 +08:00
marvzhang
bc81462a80 加入修改可配置POST接口 2019-11-28 16:08:13 +08:00
hantmac
d947852cde 修改为递归修改文件夹权限 2019-11-28 10:26:14 +08:00
hantmac
7624ec4af1 bug fix 2019-11-27 23:05:35 +08:00
marvzhang
f06c8eb785 准备前端可配置爬虫数据 2019-11-27 12:42:08 +08:00
marvzhang
2630802e6b Merge remote-tracking branch 'origin/develop' into develop 2019-11-27 12:41:51 +08:00
marvzhang
ded5703b13 准备前端可配置爬虫数据 2019-11-27 12:32:25 +08:00
marvzhang
2e569c44c4 加入前端可配置编辑器 2019-11-27 12:18:51 +08:00
marvzhang
88118cf894 准备前端可配置爬虫数据 2019-11-27 10:40:37 +08:00
Marvin Zhang
b6fba383d7 Merge pull request #321 from zhangweiii/master
fix Cannot read property length of null when first init
2019-11-27 10:02:21 +08:00
zhangweiii
8c72395ab7 fix Cannot read property length of null when first init 2019-11-27 09:45:16 +08:00
陈景阳
9bba946ba4 Merge remote-tracking branch 'upstream/develop' into upstream-develop
# Conflicts:
#	backend/services/spider.go
2019-11-26 15:30:26 +08:00