287 Commits

Author	SHA1	Message	Date
marvzhang	c4143399e5	added error notification for scrapy spiders	2020-06-18 12:54:12 +08:00
marvzhang	144769d86e	set default log expire time to 1 day	2020-06-07 21:29:28 +08:00
marvzhang	02125c2fa2	fixed unable to update node name issue	2020-06-07 12:36:09 +08:00
yaziming	5f14014f67	修复子节点名称显示错误	2020-06-03 18:11:13 +08:00
yaziming	eed50ba38f	修复子节点不能先注册的问题	2020-06-02 15:32:25 +08:00
yaziming	93c06d0464	解决节点不存在时，无法主动创建master节点的问题	2020-05-27 19:04:54 +08:00
yaziming	53b30e5676	local node	2020-05-26 16:15:05 +08:00
marvzhang	9b1cea53b6	fixed https://github.com/crawlab-team/crawlab/issues/747	2020-05-26 14:11:05 +08:00
yaziming	fe9dcdf202	GetGitRemoteBranchesPlain	2020-05-25 19:12:35 +08:00
Marvin Zhang	53614ba168	Merge pull request #741 from yaziming/reactors/simplified-cluster-watcher ... Reactors/simplified	2020-05-24 12:37:17 +08:00
yaziming	ff9c9d57ef	增加当前节点本地定时缓存，修改部分潜在BUG，启动时Mongo或者redis无法正常连接时，进入启动等待	2020-05-23 15:15:39 +08:00
yaziming	77b950f34f	GetRedisNode	2020-05-22 15:37:11 +08:00
yaziming	92a69b219b	simplified	2020-05-22 15:29:14 +08:00
yaziming	e2c876865b	simplified	2020-05-22 15:24:49 +08:00
Marvin Zhang	962daab361	Merge pull request #738 from yaziming/fix/resetting-the-git-url-not-take-effect ... fix #728	2020-05-21 12:37:19 +08:00
yaziming	9fc0a04932	fix #728	2020-05-20 14:55:47 +08:00
hantmac	8701371060	bug fix: fix es bug	2020-05-15 11:15:56 +08:00
marvzhang	a63a9a1fee	code cleanup	2020-05-15 10:44:51 +08:00
marvzhang	37fbc9d74c	disable es logging	2020-05-15 10:43:04 +08:00
marvzhang	b887a6e87e	disable es logging	2020-05-15 10:41:38 +08:00
marvzhang	88972b9685	Merge remote-tracking branch 'origin/develop' into develop	2020-05-15 10:35:15 +08:00
marvzhang	79266d4b65	fixed https://github.com/crawlab-team/crawlab/issues/732	2020-05-15 10:34:52 +08:00
yaziming	1b602d4e24	refactor(backend): Upgrade the version that depends on the library gin ... Upgrade the version that depends on the library gin	2020-05-09 17:18:10 +08:00
hantmac	872dc6660f	support custom node name	2020-04-28 20:41:42 +08:00
hantmac	a9ae673d52	support send log to ES	2020-04-27 15:59:06 +08:00
marvzhang	dd6f4fb59b	fixed https://github.com/crawlab-team/crawlab/issues/700	2020-04-23 14:58:55 +08:00
marvzhang	8a4a1d91c1	fixed https://github.com/crawlab-team/crawlab/issues/670	2020-04-21 13:31:11 +08:00
marvzhang	4a4bc296c3	升级预装node.js	2020-04-21 12:54:02 +08:00
marvzhang	c662577a85	加入Web Hook	2020-04-20 13:44:13 +08:00
marvzhang	b0806d2e94	结果集自动生成	2020-04-19 17:49:21 +08:00
marvzhang	86ea474c9a	优化自动安装依赖	2020-04-19 17:26:08 +08:00
marvzhang	b8713dfb67	加入自动安装依赖	2020-04-19 16:56:07 +08:00
marvzhang	468ee7bda0	加入日志自动删除	2020-04-19 13:50:06 +08:00
marvzhang	fc8e84ccd7	调整日志插入时间	2020-04-19 11:41:58 +08:00
marvzhang	e6ca540d11	优化日志插入	2020-04-19 11:29:50 +08:00
marvzhang	9e7a00e481	优化日志异常展示	2020-04-19 11:07:39 +08:00
marvzhang	7764b9fb82	加入日志异常检测	2020-04-19 10:32:36 +08:00
marvzhang	9d7b42e295	优化日志分页	2020-04-18 16:06:38 +08:00
marvzhang	f640eb947d	优化日志	2020-04-16 13:54:22 +08:00
marvzhang	94e1d6c431	加入日志分页	2020-04-15 13:48:27 +08:00
marvzhang	63c95f8618	迁移日志到MongoDB	2020-04-01 16:52:23 +08:00
marvzhang	08cc0c03ed	fixed issue	2020-03-30 13:09:38 +08:00
marvzhang	517cabfcd3	fixed https://github.com/crawlab-team/crawlab/issues/659	2020-03-30 12:57:43 +08:00
marvzhang	9ac1bfc588	加入重试	2020-03-29 15:45:25 +08:00
marvzhang	ea3a17f4bb	支持去重	2020-03-29 11:17:38 +08:00
marvzhang	db57a6d578	fixed https://github.com/crawlab-team/crawlab/issues/640	2020-03-24 23:24:45 +08:00
marvzhang	01d0bf9b3b	fixed https://github.com/crawlab-team/crawlab/issues/640	2020-03-24 23:14:10 +08:00
marvzhang	413c6e2fce	fixed https://github.com/crawlab-team/crawlab/issues/643 https://github.com/crawlab-team/crawlab/issues/640	2020-03-24 08:19:45 +08:00
marvzhang	d8dfab13c2	修复CLI上传Scrapy爬虫无法点击运行问题	2020-03-23 14:03:44 +08:00
marvzhang	7e343cdde1	加入权限管理	2020-03-20 17:43:11 +08:00