70 Commits

Author	SHA1	Message	Date
marvzhang	b167107b5c	加入配置只在工作节点上调度	2020-03-11 08:05:37 +08:00
marvzhang	9fc931f136	code cleanup	2020-03-11 07:43:32 +08:00
marvzhang	a24eeab68d	fixed https://github.com/crawlab-team/crawlab/issues/577	2020-02-24 09:48:23 +08:00
marvzhang	562ae39eb2	加入复制爬虫	2020-02-24 09:12:03 +08:00
marvzhang	e3883faf1c	优化爬虫列表页面	2020-02-20 11:52:28 +08:00
marvzhang	acdf4d5951	加入scrapy爬虫支持	2020-02-15 18:28:37 +08:00
marvzhang	1c7c20c11c	优化爬虫执行逻辑	2020-02-11 15:37:06 +08:00
marvzhang	6b32709a39	兼容Node.js爬虫	2020-02-10 13:23:34 +08:00
陈景阳	81edf9ab72	fix 无法及时同步爬虫的问题	2020-01-28 15:43:57 +08:00
陈景阳	092c1a2617	feature 新增全局环境变量	2020-01-28 15:12:12 +08:00
marvzhang	b70949cc87	加入消息通知类型选择	2020-01-15 14:39:51 +08:00
marvzhang	1fde42b932	将发送消息通知调整为异步	2020-01-15 13:51:12 +08:00
marvzhang	9c24126223	完成钉钉机器人消息通知	2020-01-15 13:04:59 +08:00
marvzhang	32bfb63d8f	完成钉钉机器人消息通知	2020-01-15 13:03:43 +08:00
marvzhang	8069000956	added dingtalk	2020-01-14 20:03:04 +08:00
marvzhang	875332dba7	更新邮件通知	2020-01-14 11:49:42 +08:00
marvzhang	c67c1be52a	加入用户设置与邮件通知	2020-01-13 19:56:13 +08:00
marvzhang	6f36e2fd3e	improved compatibility with crawlab-sdk	2020-01-13 12:32:06 +08:00
marvzhang	877289e382	fixed https://github.com/crawlab-team/crawlab/issues/423	2020-01-06 12:35:17 +08:00
marvzhang	7310df1be6	兼容Node.js执行	2020-01-03 14:21:47 +08:00
陈景阳	bff13e96dc	Merge remote-tracking branch 'upstream/develop' into upstream-develop	2019-12-07 10:58:24 +08:00
marvzhang	f6ac1e00b3	Merge remote-tracking branch 'origin/develop' into develop	2019-12-05 11:52:08 +08:00
marvzhang	e8edf9dac4	添加运行类别	2019-12-05 11:51:54 +08:00
陈景阳	b445457243	Merge remote-tracking branch 'upstream/develop' into upstream-develop	2019-12-05 07:18:17 +08:00
陈景阳	761e5257da	Merge remote-tracking branch 'upstream/develop' into develop	2019-12-05 07:15:07 +08:00
marvzhang	7c1e52da88	Merge remote-tracking branch 'origin/develop' into develop	2019-12-02 13:32:44 +08:00
hantmac	f58c42c6be	fix	2019-12-02 11:14:15 +08:00
hantmac	0eba6754ae	fix panic because of interface{} is nil	2019-12-02 10:11:57 +08:00
hantmac	ff6ab9a281	bug fix:修复手动或者自动删除日志后的报错	2019-11-29 13:52:03 +08:00
marvzhang	87546f0c88	准备可配置爬虫自定义设置变量	2019-11-29 13:42:50 +08:00
陈景阳	f8f4d561e9	Merge remote-tracking branch 'upstream/develop' into upstream-develop ... # Conflicts: # backend/services/spider.go	2019-11-26 15:30:26 +08:00
暗音	4f9d8635e5	Merge pull request #13 from crawlab-team/develop ... Develop	2019-11-26 15:29:18 +08:00
陈景阳	fa4d8ddc50	fix 执行爬虫错误的问题	2019-11-26 15:26:01 +08:00
marvzhang	a87950e369	加入环境变量	2019-11-25 22:07:20 +08:00
marvzhang	1c32c92c54	refactor code	2019-11-25 16:45:55 +08:00
陈景阳	cb0018ef87	关闭日志打印	2019-11-04 19:58:26 +08:00
暗音	bcf3978600	Merge branch 'develop' into develop	2019-10-28 11:06:13 +08:00
陈景阳	4ab4892471	fix 环境变量的问题	2019-10-16 15:39:25 +08:00
陈景阳	3fc97e78d8	fix 时区的问题	2019-10-16 11:26:15 +08:00
陈景阳	467796b55a	fix 一些东西	2019-10-16 10:11:00 +08:00
陈景阳	f92d2d4266	优化代码	2019-10-16 09:45:50 +08:00
陈景阳	d4c152f93a	代码优化	2019-10-15 17:23:03 +08:00
陈景阳	b56399451e	fix 定时任务管理	2019-10-11 23:22:25 +08:00
yaziming	ee808e0e60	refactor(all): refactor code ... remove redundant code and some code refactor	2019-10-11 16:01:57 +08:00
陈景阳	46d89c8cce	添加日志打印	2019-10-10 19:56:04 +08:00
陈景阳	f5af83dcce	修改版本号	2019-10-08 20:26:08 +08:00
陈景阳	6b90d86ea2	fix 状态的问题	2019-10-08 20:20:48 +08:00
陈景阳	a081b02c13	fix 状态的问题	2019-10-08 20:16:49 +08:00
陈景阳	4c8b38f40b	fix 状态错误的问题	2019-10-08 19:41:29 +08:00
陈景阳	41556cab74	fix 删除爬虫的问题	2019-09-30 12:09:37 +08:00