100 Commits

Author	SHA1	Message	Date
zkqiang	77f7e889ba	fixed build error of windows	2020-09-20 12:35:21 +08:00
marvzhang	0a292248b4	added system tasks	2020-07-31 13:13:49 +08:00
marvzhang	154813ceff	added part of the system tasks logic	2020-07-30 23:06:11 +08:00
marvzhang	9616ba54c7	fixed https://github.com/crawlab-team/crawlab/issues/813	2020-07-26 17:38:12 +08:00
zkqiang	72eea9589a	fix stdout reader	2020-07-11 20:55:05 +08:00
marvzhang	ac9a36d4a1	fixed https://github.com/crawlab-team/crawlab/issues/787	2020-07-03 17:28:07 +08:00
marvzhang	331fa3338b	set default log expire time to 1 day	2020-06-07 21:29:28 +08:00
marvzhang	4a60f43c44	fixed https://github.com/crawlab-team/crawlab/issues/747	2020-05-26 14:11:05 +08:00
yaziming	22774dd041	增加当前节点本地定时缓存，修改部分潜在BUG，启动时Mongo或者redis无法正常连接时，进入启动等待	2020-05-23 15:15:39 +08:00
hantmac	e7c0bfadaf	bug fix: fix es bug	2020-05-15 11:15:56 +08:00
marvzhang	f8e773d4f3	disable es logging	2020-05-15 10:43:04 +08:00
marvzhang	03a656619b	disable es logging	2020-05-15 10:41:38 +08:00
hantmac	14159c46a5	support send log to ES	2020-04-27 15:59:06 +08:00
marvzhang	6446ec9c5a	fixed https://github.com/crawlab-team/crawlab/issues/700	2020-04-23 14:58:55 +08:00
marvzhang	730349e28e	升级预装node.js	2020-04-21 12:54:02 +08:00
marvzhang	052757960e	加入Web Hook	2020-04-20 13:44:13 +08:00
marvzhang	b0a930ca32	结果集自动生成	2020-04-19 17:49:21 +08:00
marvzhang	6508e80de5	加入日志自动删除	2020-04-19 13:50:06 +08:00
marvzhang	be43bfc4f7	调整日志插入时间	2020-04-19 11:41:58 +08:00
marvzhang	9e3cc909f3	优化日志插入	2020-04-19 11:29:50 +08:00
marvzhang	5a8da7ed29	优化日志异常展示	2020-04-19 11:07:39 +08:00
marvzhang	59b42ddde2	加入日志异常检测	2020-04-19 10:32:36 +08:00
marvzhang	55cf81a6a0	优化日志分页	2020-04-18 16:06:38 +08:00
marvzhang	a07c001ccb	优化日志	2020-04-16 13:54:22 +08:00
marvzhang	624972fc73	加入日志分页	2020-04-15 13:48:27 +08:00
marvzhang	7057608ef7	迁移日志到MongoDB	2020-04-01 16:52:23 +08:00
marvzhang	12ff76e846	fixed https://github.com/crawlab-team/crawlab/issues/659	2020-03-30 12:57:43 +08:00
marvzhang	1ddeaef69b	加入重试	2020-03-29 15:45:25 +08:00
marvzhang	bff9356a0f	支持去重	2020-03-29 11:17:38 +08:00
marvzhang	83c657dc49	fixed https://github.com/crawlab-team/crawlab/issues/643 https://github.com/crawlab-team/crawlab/issues/640	2020-03-24 08:19:45 +08:00
marvzhang	d2ed7e6379	加入配置只在工作节点上调度	2020-03-11 08:05:37 +08:00
marvzhang	74b1f509db	code cleanup	2020-03-11 07:43:32 +08:00
marvzhang	cc2ec7a34c	fixed https://github.com/crawlab-team/crawlab/issues/577	2020-02-24 09:48:23 +08:00
marvzhang	7315deefee	加入复制爬虫	2020-02-24 09:12:03 +08:00
marvzhang	17bdbaf8dd	优化爬虫列表页面	2020-02-20 11:52:28 +08:00
marvzhang	d46f43b05b	加入scrapy爬虫支持	2020-02-15 18:28:37 +08:00
marvzhang	fd62adc8ba	优化爬虫执行逻辑	2020-02-11 15:37:06 +08:00
marvzhang	8d1d7c9b1d	兼容Node.js爬虫	2020-02-10 13:23:34 +08:00
陈景阳	4825653ae0	fix 无法及时同步爬虫的问题	2020-01-28 15:43:57 +08:00
陈景阳	b139c7fe6c	feature 新增全局环境变量	2020-01-28 15:12:12 +08:00
marvzhang	9195606e2d	加入消息通知类型选择	2020-01-15 14:39:51 +08:00
marvzhang	f5b22cba7a	将发送消息通知调整为异步	2020-01-15 13:51:12 +08:00
marvzhang	ee0e231ad4	完成钉钉机器人消息通知	2020-01-15 13:04:59 +08:00
marvzhang	eab6b39603	完成钉钉机器人消息通知	2020-01-15 13:03:43 +08:00
marvzhang	11e74e23b4	added dingtalk	2020-01-14 20:03:04 +08:00
marvzhang	510585d83a	更新邮件通知	2020-01-14 11:49:42 +08:00
marvzhang	659874a4ee	加入用户设置与邮件通知	2020-01-13 19:56:13 +08:00
marvzhang	746abbdc04	improved compatibility with crawlab-sdk	2020-01-13 12:32:06 +08:00
marvzhang	a74b949d8d	fixed https://github.com/crawlab-team/crawlab/issues/423	2020-01-06 12:35:17 +08:00
marvzhang	8fd5935417	兼容Node.js执行	2020-01-03 14:21:47 +08:00