276 Commits

Author	SHA1	Message	Date
marvzhang	40170372c3	Merge remote-tracking branch 'origin/develop' into develop	2019-12-26 12:48:33 +08:00
marvzhang	b40028692c	修复添加爬虫后直接运行错误	2019-12-26 12:47:56 +08:00
yaziming	659aae4abb	fix(backend): ... 临时解决修复偶发mongo多节点信息的问题，后续需重构	2019-12-26 11:26:41 +08:00
marvzhang	61927cb214	updated version	2019-12-26 11:08:55 +08:00
marvzhang	01aea28c9c	添加文件管理功能（后端）	2019-12-25 20:49:43 +08:00
marvzhang	715761049e	Merge remote-tracking branch 'origin/develop' into develop	2019-12-25 19:47:02 +08:00
marvzhang	fdcf12f866	优化添加爬虫逻辑	2019-12-25 19:46:09 +08:00
yaziming	086d50f512	fix(backend): ... 修复redis连接池订阅消息失败时，因为ping操作优先获取到错误造成chain提前关闭引发panic的问题	2019-12-25 14:02:45 +08:00
hantmac	ec9525cb1a	fix	2019-12-24 16:44:54 +08:00
hantmac	893476bd0b	尝试解决节点重复注册问题	2019-12-24 16:11:24 +08:00
marvzhang	27b167bc06	加入爬虫文件管理后端 API	2019-12-24 09:12:35 +08:00
marvzhang	936adf6f76	加入爬虫文件管理后端 API	2019-12-24 09:11:42 +08:00
marvzhang	7eaad2cb7c	updated CHANGELOG.md	2019-12-20 13:13:05 +08:00
marvzhang	ed7f933aee	fixed https://github.com/crawlab-team/crawlab/issues/346	2019-12-20 12:45:37 +08:00
marvzhang	038e3041a3	fixed https://github.com/crawlab-team/crawlab/issues/371	2019-12-20 09:58:04 +08:00
hantmac	3ab85ef226	Add API GetVersion	2019-12-19 21:16:25 +08:00
marvzhang	234db7196c	fixed https://github.com/crawlab-team/crawlab/issues/373	2019-12-19 10:42:20 +08:00
Marvin Zhang	ff405dd2ee	Merge pull request #370 from wo10378931/develop ... Develop	2019-12-17 10:09:37 +08:00
陈景阳	935b3e2c47	去掉select 语句的break关键字	2019-12-17 10:07:38 +08:00
hantmac	0387bbdc02	Update test cases	2019-12-15 09:18:13 +08:00
marvzhang	a067c1c1ad	将可配置爬虫stages调整为列表	2019-12-13 12:55:53 +08:00
陈景阳	d8061dbf8f	优化代码，添加注释	2019-12-12 20:52:09 +08:00
marvzhang	26227dd0dc	修复定时任务不一致问题	2019-12-12 13:13:42 +08:00
陈景阳	c071a93c5b	fix 同步锁可能异常的情况	2019-12-10 09:22:09 +08:00
陈景阳	069d861be9	fix 错误信息的返回	2019-12-09 11:23:30 +08:00
陈景阳	280877a0ae	完成可能重复注册节点的问题	2019-12-09 10:28:48 +08:00
陈景阳	f9f04093d9	完成批量删除Task任务列表	2019-12-08 10:58:02 +08:00
陈景阳	58df4c4a96	Feature 新增定时任务可暂停/运行	2019-12-07 14:02:54 +08:00
陈景阳	bff13e96dc	Merge remote-tracking branch 'upstream/develop' into upstream-develop	2019-12-07 10:58:24 +08:00
hantmac	6d7efa465d	新增authGroup.DELETE(/tasks_by_status, routes.DeleteTaskByStatus) 支持批量删除指定状态的任务	2019-12-06 10:08:45 +08:00
hantmac	07ce8e25fd	- 新增authGroup.DELETE("/tasks_by_status", routes.DeleteTaskByStatus) 支持批量删除指定状态的任务 ... - TaskListRequestData中增加Status字段，支持根据task状态进行筛选	2019-12-05 15:12:32 +08:00
marvzhang	f6ac1e00b3	Merge remote-tracking branch 'origin/develop' into develop	2019-12-05 11:52:08 +08:00
marvzhang	e8edf9dac4	添加运行类别	2019-12-05 11:51:54 +08:00
陈景阳	b445457243	Merge remote-tracking branch 'upstream/develop' into upstream-develop	2019-12-05 07:18:17 +08:00
陈景阳	761e5257da	Merge remote-tracking branch 'upstream/develop' into develop	2019-12-05 07:15:07 +08:00
hantmac	c230e393d7	fix	2019-12-04 16:48:36 +08:00
hantmac	cf9ed1b65c	修改isDeletePeriodically参数默认为N	2019-12-04 16:46:16 +08:00
marvzhang	3761d906c8	修复爬虫被覆盖的问题	2019-12-04 14:54:49 +08:00
marvzhang	6d9c162e9e	优先调整xpath顺序	2019-12-04 13:57:27 +08:00
marvzhang	40f6675ce8	更新Spiderfile模版	2019-12-03 14:25:54 +08:00
marvzhang	98cbccb81e	加入Spiderfile模版	2019-12-03 13:37:41 +08:00
marvzhang	9e849695d1	更新可配置爬虫	2019-12-03 12:14:38 +08:00
marvzhang	c3bc20127d	更新可配置爬虫	2019-12-02 22:35:45 +08:00
marvzhang	bca50c0f19	加入依赖模块	2019-12-02 17:46:57 +08:00
marvzhang	7c1e52da88	Merge remote-tracking branch 'origin/develop' into develop	2019-12-02 13:32:44 +08:00
hantmac	f58c42c6be	fix	2019-12-02 11:14:15 +08:00
hantmac	0eba6754ae	fix panic because of interface{} is nil	2019-12-02 10:11:57 +08:00
hantmac	d0a92add12	Merge remote-tracking branch 'crawlab-team/develop' into develop	2019-12-01 18:36:22 +08:00
Jeremy	6f5dc4aa95	Merge pull request #330 from appleboy/patch-3 ... chore: fix fmt warning.	2019-12-01 18:29:42 +08:00
Bo-Yi Wu	bd0ccdcb38	chore: fix fmt warning.	2019-12-01 18:16:39 +08:00