Commit Graph

154 Commits

Author SHA1 Message Date
陈景阳
210f76b5ea fix 前端报错的问题 2020-01-07 01:32:11 +08:00
暗音
f3c64712c8 Merge branch 'develop' into develop 2020-01-07 00:53:18 +08:00
marvzhang
2c3f440c8e 加入爬虫列表排序 2020-01-06 13:18:29 +08:00
marvzhang
a74b949d8d fixed https://github.com/crawlab-team/crawlab/issues/423 2020-01-06 12:35:17 +08:00
marvzhang
e725812b9b 添加docker安装node 2020-01-03 15:45:18 +08:00
marvzhang
8fd5935417 兼容Node.js执行 2020-01-03 14:21:47 +08:00
marvzhang
2cf12da03b 加入Node.js依赖安装和语言安装 2020-01-03 13:53:06 +08:00
marvzhang
762bd75334 优化代码 2020-01-03 11:12:46 +08:00
marvzhang
9a5ec98925 优化依赖安装 2020-01-03 10:54:20 +08:00
marvzhang
ca15e22312 加入卸载依赖逻辑 2020-01-02 17:38:39 +08:00
marvzhang
152e94da01 加入RPC机制,完成部分依赖安装逻辑 2020-01-02 15:53:53 +08:00
marvzhang
fa87c419a2 fixed https://github.com/crawlab-team/crawlab/issues/391 2020-01-02 12:51:21 +08:00
marvzhang
8d69de4388 fixed https://github.com/crawlab-team/crawlab/issues/391 2020-01-02 11:16:42 +08:00
陈景阳
4e66f6f3d2 优化UI界面 2020-01-02 10:07:21 +08:00
marvzhang
6bf6212a22 加入依赖安装前端 2019-12-31 17:05:15 +08:00
marvzhang
8425ff26e8 更新依赖安装逻辑 2019-12-31 12:02:47 +08:00
marvzhang
6e0718e646 添加文件管理功能(后端) 2019-12-25 20:49:43 +08:00
hantmac
8888e71d1b fix 2019-12-24 16:44:54 +08:00
hantmac
e16164f63a 尝试解决节点重复注册问题 2019-12-24 16:11:24 +08:00
Marvin Zhang
32c07c5270 Merge pull request #370 from wo10378931/develop
Develop
2019-12-17 10:09:37 +08:00
陈景阳
232c299949 去掉select 语句的break关键字 2019-12-17 10:07:38 +08:00
marvzhang
3ef794f7a2 将可配置爬虫stages调整为列表 2019-12-13 12:55:53 +08:00
陈景阳
c64ea5c250 优化代码,添加注释 2019-12-12 20:52:09 +08:00
marvzhang
0cf745767c 修复定时任务不一致问题 2019-12-12 13:13:42 +08:00
陈景阳
728dbd5147 fix 同步锁可能异常的情况 2019-12-10 09:22:09 +08:00
陈景阳
b4c160fe22 完成可能重复注册节点的问题 2019-12-09 10:28:48 +08:00
陈景阳
6e7634d70f Feature 新增定时任务可暂停/运行 2019-12-07 14:02:54 +08:00
陈景阳
6fb831b322 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-12-07 10:58:24 +08:00
hantmac
4bf72c9df1 新增authGroup.DELETE(/tasks_by_status, routes.DeleteTaskByStatus) 支持批量删除指定状态的任务 2019-12-06 10:08:45 +08:00
hantmac
a74fd82b6a - 新增authGroup.DELETE("/tasks_by_status", routes.DeleteTaskByStatus) 支持批量删除指定状态的任务
- TaskListRequestData中增加Status字段,支持根据task状态进行筛选
2019-12-05 15:12:32 +08:00
marvzhang
f5bf36ef49 Merge remote-tracking branch 'origin/develop' into develop 2019-12-05 11:52:08 +08:00
marvzhang
f8cf5b3241 添加运行类别 2019-12-05 11:51:54 +08:00
陈景阳
0c5ae35297 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-12-05 07:18:17 +08:00
陈景阳
026c9756b9 Merge remote-tracking branch 'upstream/develop' into develop 2019-12-05 07:15:07 +08:00
marvzhang
97ca3b74b8 修复爬虫被覆盖的问题 2019-12-04 14:54:49 +08:00
marvzhang
be4a5f6667 优先调整xpath顺序 2019-12-04 13:57:27 +08:00
marvzhang
c237c0cf96 Merge remote-tracking branch 'origin/develop' into develop 2019-12-02 13:32:44 +08:00
hantmac
67ae278a66 fix 2019-12-02 11:14:15 +08:00
hantmac
8f06646d99 fix panic because of interface{} is nil 2019-12-02 10:11:57 +08:00
marvzhang
08c7aec49c 加入可配置爬虫阶段设置 2019-11-30 10:58:54 +08:00
hantmac
61daf732bd bug fix:修复手动或者自动删除日志后的报错 2019-11-29 13:52:03 +08:00
marvzhang
a1bfe00eee 准备可配置爬虫自定义设置变量 2019-11-29 13:42:50 +08:00
marvzhang
ba4f5fd20c 优化可配置爬虫前端界面 2019-11-28 21:36:17 +08:00
marvzhang
bc81462a80 加入修改可配置POST接口 2019-11-28 16:08:13 +08:00
hantmac
d947852cde 修改为递归修改文件夹权限 2019-11-28 10:26:14 +08:00
hantmac
7624ec4af1 bug fix 2019-11-27 23:05:35 +08:00
陈景阳
9bba946ba4 Merge remote-tracking branch 'upstream/develop' into upstream-develop
# Conflicts:
#	backend/services/spider.go
2019-11-26 15:30:26 +08:00
暗音
3ef5ddfa07 Merge pull request #13 from crawlab-team/develop
Develop
2019-11-26 15:29:18 +08:00
陈景阳
97e5d5b65f fix 执行爬虫错误的问题 2019-11-26 15:26:01 +08:00
marvzhang
bc5203267a 加入xpath 2019-11-26 13:02:49 +08:00