135 Commits

Author	SHA1	Message	Date
Marvin Zhang	ff405dd2ee	Merge pull request #370 from wo10378931/develop ... Develop	2019-12-17 10:09:37 +08:00
陈景阳	935b3e2c47	去掉select 语句的break关键字	2019-12-17 10:07:38 +08:00
marvzhang	a067c1c1ad	将可配置爬虫stages调整为列表	2019-12-13 12:55:53 +08:00
陈景阳	d8061dbf8f	优化代码，添加注释	2019-12-12 20:52:09 +08:00
marvzhang	26227dd0dc	修复定时任务不一致问题	2019-12-12 13:13:42 +08:00
陈景阳	c071a93c5b	fix 同步锁可能异常的情况	2019-12-10 09:22:09 +08:00
陈景阳	280877a0ae	完成可能重复注册节点的问题	2019-12-09 10:28:48 +08:00
陈景阳	58df4c4a96	Feature 新增定时任务可暂停/运行	2019-12-07 14:02:54 +08:00
陈景阳	bff13e96dc	Merge remote-tracking branch 'upstream/develop' into upstream-develop	2019-12-07 10:58:24 +08:00
hantmac	6d7efa465d	新增authGroup.DELETE(/tasks_by_status, routes.DeleteTaskByStatus) 支持批量删除指定状态的任务	2019-12-06 10:08:45 +08:00
hantmac	07ce8e25fd	- 新增authGroup.DELETE("/tasks_by_status", routes.DeleteTaskByStatus) 支持批量删除指定状态的任务 ... - TaskListRequestData中增加Status字段，支持根据task状态进行筛选	2019-12-05 15:12:32 +08:00
marvzhang	f6ac1e00b3	Merge remote-tracking branch 'origin/develop' into develop	2019-12-05 11:52:08 +08:00
marvzhang	e8edf9dac4	添加运行类别	2019-12-05 11:51:54 +08:00
陈景阳	b445457243	Merge remote-tracking branch 'upstream/develop' into upstream-develop	2019-12-05 07:18:17 +08:00
陈景阳	761e5257da	Merge remote-tracking branch 'upstream/develop' into develop	2019-12-05 07:15:07 +08:00
marvzhang	3761d906c8	修复爬虫被覆盖的问题	2019-12-04 14:54:49 +08:00
marvzhang	6d9c162e9e	优先调整xpath顺序	2019-12-04 13:57:27 +08:00
marvzhang	7c1e52da88	Merge remote-tracking branch 'origin/develop' into develop	2019-12-02 13:32:44 +08:00
hantmac	f58c42c6be	fix	2019-12-02 11:14:15 +08:00
hantmac	0eba6754ae	fix panic because of interface{} is nil	2019-12-02 10:11:57 +08:00
marvzhang	5405dba540	加入可配置爬虫阶段设置	2019-11-30 10:58:54 +08:00
hantmac	ff6ab9a281	bug fix:修复手动或者自动删除日志后的报错	2019-11-29 13:52:03 +08:00
marvzhang	87546f0c88	准备可配置爬虫自定义设置变量	2019-11-29 13:42:50 +08:00
marvzhang	d65e37517e	优化可配置爬虫前端界面	2019-11-28 21:36:17 +08:00
marvzhang	8210fa6c20	加入修改可配置POST接口	2019-11-28 16:08:13 +08:00
hantmac	389da906ef	修改为递归修改文件夹权限	2019-11-28 10:26:14 +08:00
hantmac	429135eb46	bug fix	2019-11-27 23:05:35 +08:00
陈景阳	f8f4d561e9	Merge remote-tracking branch 'upstream/develop' into upstream-develop ... # Conflicts: # backend/services/spider.go	2019-11-26 15:30:26 +08:00
暗音	4f9d8635e5	Merge pull request #13 from crawlab-team/develop ... Develop	2019-11-26 15:29:18 +08:00
陈景阳	fa4d8ddc50	fix 执行爬虫错误的问题	2019-11-26 15:26:01 +08:00
marvzhang	b676a84e49	加入xpath	2019-11-26 13:02:49 +08:00
marvzhang	bfce15d54e	加入Spiderfile限制条件	2019-11-26 12:44:24 +08:00
marvzhang	a87950e369	加入环境变量	2019-11-25 22:07:20 +08:00
marvzhang	1c32c92c54	refactor code	2019-11-25 16:45:55 +08:00
marvzhang	9c282ddb4d	加入可配置爬虫	2019-11-24 17:57:12 +08:00
marvzhang	7003951561	fixed https://github.com/crawlab-team/crawlab/issues/315	2019-11-24 12:20:44 +08:00
marvzhang	607ce70f5c	准备可配置爬虫	2019-11-23 18:13:47 +08:00
Jeremy	7755c3e74c	bug fix register.go ... fix data race because of register solve issue https://github.com/crawlab-team/crawlab/issues/308	2019-11-19 17:03:46 +08:00
陈景阳	cb0018ef87	关闭日志打印	2019-11-04 19:58:26 +08:00
陈景阳	9427283e3a	fix 循环依赖的问题	2019-10-28 13:51:12 +08:00
暗音	bcf3978600	Merge branch 'develop' into develop	2019-10-28 11:06:13 +08:00
陈景阳	418d728825	修改日志获取问题	2019-10-17 17:54:19 +08:00
陈景阳	4ab4892471	fix 环境变量的问题	2019-10-16 15:39:25 +08:00
陈景阳	b3b2efd611	fix 定时任务参数错误的问题	2019-10-16 15:27:12 +08:00
陈景阳	3fc97e78d8	fix 时区的问题	2019-10-16 11:26:15 +08:00
陈景阳	467796b55a	fix 一些东西	2019-10-16 10:11:00 +08:00
陈景阳	f92d2d4266	优化代码	2019-10-16 09:45:50 +08:00
陈景阳	d4c152f93a	代码优化	2019-10-15 17:23:03 +08:00
陈景阳	6af06efc17	fix worker无法获取到当前Node的问题	2019-10-12 07:16:11 +08:00
陈景阳	b56399451e	fix 定时任务管理	2019-10-11 23:22:25 +08:00