153 Commits

Author	SHA1	Message	Date
暗音	f3c64712c8	Merge branch 'develop' into develop	2020-01-07 00:53:18 +08:00
marvzhang	2c3f440c8e	加入爬虫列表排序	2020-01-06 13:18:29 +08:00
marvzhang	a74b949d8d	fixed https://github.com/crawlab-team/crawlab/issues/423	2020-01-06 12:35:17 +08:00
marvzhang	e725812b9b	添加docker安装node	2020-01-03 15:45:18 +08:00
marvzhang	8fd5935417	兼容Node.js执行	2020-01-03 14:21:47 +08:00
marvzhang	2cf12da03b	加入Node.js依赖安装和语言安装	2020-01-03 13:53:06 +08:00
marvzhang	762bd75334	优化代码	2020-01-03 11:12:46 +08:00
marvzhang	9a5ec98925	优化依赖安装	2020-01-03 10:54:20 +08:00
marvzhang	ca15e22312	加入卸载依赖逻辑	2020-01-02 17:38:39 +08:00
marvzhang	152e94da01	加入RPC机制，完成部分依赖安装逻辑	2020-01-02 15:53:53 +08:00
marvzhang	fa87c419a2	fixed https://github.com/crawlab-team/crawlab/issues/391	2020-01-02 12:51:21 +08:00
marvzhang	8d69de4388	fixed https://github.com/crawlab-team/crawlab/issues/391	2020-01-02 11:16:42 +08:00
陈景阳	4e66f6f3d2	优化UI界面	2020-01-02 10:07:21 +08:00
marvzhang	6bf6212a22	加入依赖安装前端	2019-12-31 17:05:15 +08:00
marvzhang	8425ff26e8	更新依赖安装逻辑	2019-12-31 12:02:47 +08:00
marvzhang	6e0718e646	添加文件管理功能（后端）	2019-12-25 20:49:43 +08:00
hantmac	8888e71d1b	fix	2019-12-24 16:44:54 +08:00
hantmac	e16164f63a	尝试解决节点重复注册问题	2019-12-24 16:11:24 +08:00
Marvin Zhang	32c07c5270	Merge pull request #370 from wo10378931/develop ... Develop	2019-12-17 10:09:37 +08:00
陈景阳	232c299949	去掉select 语句的break关键字	2019-12-17 10:07:38 +08:00
marvzhang	3ef794f7a2	将可配置爬虫stages调整为列表	2019-12-13 12:55:53 +08:00
陈景阳	c64ea5c250	优化代码，添加注释	2019-12-12 20:52:09 +08:00
marvzhang	0cf745767c	修复定时任务不一致问题	2019-12-12 13:13:42 +08:00
陈景阳	728dbd5147	fix 同步锁可能异常的情况	2019-12-10 09:22:09 +08:00
陈景阳	b4c160fe22	完成可能重复注册节点的问题	2019-12-09 10:28:48 +08:00
陈景阳	6e7634d70f	Feature 新增定时任务可暂停/运行	2019-12-07 14:02:54 +08:00
陈景阳	6fb831b322	Merge remote-tracking branch 'upstream/develop' into upstream-develop	2019-12-07 10:58:24 +08:00
hantmac	4bf72c9df1	新增authGroup.DELETE(/tasks_by_status, routes.DeleteTaskByStatus) 支持批量删除指定状态的任务	2019-12-06 10:08:45 +08:00
hantmac	a74fd82b6a	- 新增authGroup.DELETE("/tasks_by_status", routes.DeleteTaskByStatus) 支持批量删除指定状态的任务 ... - TaskListRequestData中增加Status字段，支持根据task状态进行筛选	2019-12-05 15:12:32 +08:00
marvzhang	f5bf36ef49	Merge remote-tracking branch 'origin/develop' into develop	2019-12-05 11:52:08 +08:00
marvzhang	f8cf5b3241	添加运行类别	2019-12-05 11:51:54 +08:00
陈景阳	0c5ae35297	Merge remote-tracking branch 'upstream/develop' into upstream-develop	2019-12-05 07:18:17 +08:00
陈景阳	026c9756b9	Merge remote-tracking branch 'upstream/develop' into develop	2019-12-05 07:15:07 +08:00
marvzhang	97ca3b74b8	修复爬虫被覆盖的问题	2019-12-04 14:54:49 +08:00
marvzhang	be4a5f6667	优先调整xpath顺序	2019-12-04 13:57:27 +08:00
marvzhang	c237c0cf96	Merge remote-tracking branch 'origin/develop' into develop	2019-12-02 13:32:44 +08:00
hantmac	67ae278a66	fix	2019-12-02 11:14:15 +08:00
hantmac	8f06646d99	fix panic because of interface{} is nil	2019-12-02 10:11:57 +08:00
marvzhang	08c7aec49c	加入可配置爬虫阶段设置	2019-11-30 10:58:54 +08:00
hantmac	61daf732bd	bug fix:修复手动或者自动删除日志后的报错	2019-11-29 13:52:03 +08:00
marvzhang	a1bfe00eee	准备可配置爬虫自定义设置变量	2019-11-29 13:42:50 +08:00
marvzhang	ba4f5fd20c	优化可配置爬虫前端界面	2019-11-28 21:36:17 +08:00
marvzhang	bc81462a80	加入修改可配置POST接口	2019-11-28 16:08:13 +08:00
hantmac	d947852cde	修改为递归修改文件夹权限	2019-11-28 10:26:14 +08:00
hantmac	7624ec4af1	bug fix	2019-11-27 23:05:35 +08:00
陈景阳	9bba946ba4	Merge remote-tracking branch 'upstream/develop' into upstream-develop ... # Conflicts: # backend/services/spider.go	2019-11-26 15:30:26 +08:00
暗音	3ef5ddfa07	Merge pull request #13 from crawlab-team/develop ... Develop	2019-11-26 15:29:18 +08:00
陈景阳	97e5d5b65f	fix 执行爬虫错误的问题	2019-11-26 15:26:01 +08:00
marvzhang	bc5203267a	加入xpath	2019-11-26 13:02:49 +08:00
marvzhang	8046d94cc3	加入Spiderfile限制条件	2019-11-26 12:44:24 +08:00