Commit Graph

283 Commits

Author SHA1 Message Date
陈景阳
4e66f6f3d2 优化UI界面 2020-01-02 10:07:21 +08:00
marvzhang
6bf6212a22 加入依赖安装前端 2019-12-31 17:05:15 +08:00
marvzhang
c3d242a9bc updated vendor 2019-12-31 12:04:51 +08:00
marvzhang
8425ff26e8 更新依赖安装逻辑 2019-12-31 12:02:47 +08:00
marvzhang
3a1b945d09 fixed https://github.com/crawlab-team/crawlab/issues/407 2019-12-30 13:39:36 +08:00
marvzhang
2f47a929d0 解决上传爬虫报错问题 2019-12-27 17:24:23 +08:00
marvzhang
81ff9f0f82 fixed https://github.com/crawlab-team/crawlab/issues/403 2019-12-27 16:06:34 +08:00
marvzhang
85929d3c05 Merge remote-tracking branch 'origin/develop' into develop 2019-12-26 12:48:33 +08:00
marvzhang
59d2d41fe7 修复添加爬虫后直接运行错误 2019-12-26 12:47:56 +08:00
yaziming
6dced83896 fix(backend):
临时解决修复偶发mongo多节点信息的问题,后续需重构
2019-12-26 11:26:41 +08:00
marvzhang
a50141c9a8 updated version 2019-12-26 11:08:55 +08:00
marvzhang
6e0718e646 添加文件管理功能(后端) 2019-12-25 20:49:43 +08:00
marvzhang
dff0f6fbc4 Merge remote-tracking branch 'origin/develop' into develop 2019-12-25 19:47:02 +08:00
marvzhang
8910a74b5d 优化添加爬虫逻辑 2019-12-25 19:46:09 +08:00
yaziming
5fc2370f24 fix(backend):
修复redis连接池订阅消息失败时,因为ping操作优先获取到错误造成chain提前关闭引发panic的问题
2019-12-25 14:02:45 +08:00
hantmac
8888e71d1b fix 2019-12-24 16:44:54 +08:00
hantmac
e16164f63a 尝试解决节点重复注册问题 2019-12-24 16:11:24 +08:00
marvzhang
9b7eeb9532 加入爬虫文件管理后端 API 2019-12-24 09:12:35 +08:00
marvzhang
a43365c6e7 加入爬虫文件管理后端 API 2019-12-24 09:11:42 +08:00
marvzhang
b35c09d362 updated CHANGELOG.md 2019-12-20 13:13:05 +08:00
marvzhang
28a3a53176 fixed https://github.com/crawlab-team/crawlab/issues/346 2019-12-20 12:45:37 +08:00
marvzhang
be4932f5aa fixed https://github.com/crawlab-team/crawlab/issues/371 2019-12-20 09:58:04 +08:00
hantmac
51b31e56aa Add API GetVersion 2019-12-19 21:16:25 +08:00
marvzhang
44c9bde96f fixed https://github.com/crawlab-team/crawlab/issues/373 2019-12-19 10:42:20 +08:00
Marvin Zhang
32c07c5270 Merge pull request #370 from wo10378931/develop
Develop
2019-12-17 10:09:37 +08:00
陈景阳
232c299949 去掉select 语句的break关键字 2019-12-17 10:07:38 +08:00
hantmac
7fff86feb1 Update test cases 2019-12-15 09:18:13 +08:00
marvzhang
3ef794f7a2 将可配置爬虫stages调整为列表 2019-12-13 12:55:53 +08:00
陈景阳
c64ea5c250 优化代码,添加注释 2019-12-12 20:52:09 +08:00
marvzhang
0cf745767c 修复定时任务不一致问题 2019-12-12 13:13:42 +08:00
陈景阳
728dbd5147 fix 同步锁可能异常的情况 2019-12-10 09:22:09 +08:00
陈景阳
68324d2ec5 fix 错误信息的返回 2019-12-09 11:23:30 +08:00
陈景阳
b4c160fe22 完成可能重复注册节点的问题 2019-12-09 10:28:48 +08:00
陈景阳
0daeb33699 完成批量删除Task任务列表 2019-12-08 10:58:02 +08:00
陈景阳
6e7634d70f Feature 新增定时任务可暂停/运行 2019-12-07 14:02:54 +08:00
陈景阳
6fb831b322 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-12-07 10:58:24 +08:00
hantmac
4bf72c9df1 新增authGroup.DELETE(/tasks_by_status, routes.DeleteTaskByStatus) 支持批量删除指定状态的任务 2019-12-06 10:08:45 +08:00
hantmac
a74fd82b6a - 新增authGroup.DELETE("/tasks_by_status", routes.DeleteTaskByStatus) 支持批量删除指定状态的任务
- TaskListRequestData中增加Status字段,支持根据task状态进行筛选
2019-12-05 15:12:32 +08:00
marvzhang
f5bf36ef49 Merge remote-tracking branch 'origin/develop' into develop 2019-12-05 11:52:08 +08:00
marvzhang
f8cf5b3241 添加运行类别 2019-12-05 11:51:54 +08:00
陈景阳
0c5ae35297 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-12-05 07:18:17 +08:00
陈景阳
026c9756b9 Merge remote-tracking branch 'upstream/develop' into develop 2019-12-05 07:15:07 +08:00
hantmac
5bb8be1ddd fix 2019-12-04 16:48:36 +08:00
hantmac
88a22097da 修改isDeletePeriodically参数默认为N 2019-12-04 16:46:16 +08:00
marvzhang
97ca3b74b8 修复爬虫被覆盖的问题 2019-12-04 14:54:49 +08:00
marvzhang
be4a5f6667 优先调整xpath顺序 2019-12-04 13:57:27 +08:00
marvzhang
82c6b80063 更新Spiderfile模版 2019-12-03 14:25:54 +08:00
marvzhang
589190d674 加入Spiderfile模版 2019-12-03 13:37:41 +08:00
marvzhang
9c5c0bd270 更新可配置爬虫 2019-12-03 12:14:38 +08:00
marvzhang
af680d576a 更新可配置爬虫 2019-12-02 22:35:45 +08:00