141 Commits

Author	SHA1	Message	Date
marvzhang	74f7f59036	added system tasks	2020-07-31 13:13:49 +08:00
marvzhang	d525099568	added part of the system tasks logic	2020-07-30 23:06:11 +08:00
marvzhang	4cca9cf80f	fixed https://github.com/crawlab-team/crawlab/issues/811	2020-07-26 10:40:23 +08:00
marvzhang	6c098c7095	updated node offline task update	2020-07-18 22:13:05 +08:00
marvzhang	d973aa39a7	added batch set projects	2020-07-18 10:58:06 +08:00
marvzhang	31c3c91545	added batch run tasks	2020-07-17 15:58:55 +08:00
marvzhang	2abb450574	fixed git issue	2020-07-08 10:25:58 +08:00
Marvin Zhang	373d1e5110	Merge pull request #767 from sniperyen/master ... fix: start next stage only if url is not empty	2020-06-07 16:56:03 +08:00
sniperyen	095b85cb73	fix: start next stage only if url is not empty	2020-06-04 00:39:58 +07:00
yaziming	53b30e5676	local node	2020-05-26 16:15:05 +08:00
Marvin Zhang	64ee535c50	Merge pull request #744 from yaziming/crawlab_optimization_1 ... optimization_1	2020-05-24 12:36:08 +08:00
yaziming	ff9c9d57ef	增加当前节点本地定时缓存，修改部分潜在BUG，启动时Mongo或者redis无法正常连接时，进入启动等待	2020-05-23 15:15:39 +08:00
yaziming	14e638b2ed	Add ShouldBindMulti and generate vendor	2020-05-23 12:03:34 +08:00
Marvin Zhang	b5c111bf28	Merge pull request #723 from bestgopher/optimization ... 一点小优化	2020-05-08 16:32:30 +08:00
bestgopher	3964cabc53	一点小优化	2020-05-08 16:08:54 +08:00
zkqiang	422fbf7b0d	fixed bug	2020-05-04 15:50:12 +08:00
hantmac	872dc6660f	support custom node name	2020-04-28 20:41:42 +08:00
hantmac	a9ae673d52	support send log to ES	2020-04-27 15:59:06 +08:00
marvzhang	c662577a85	加入Web Hook	2020-04-20 13:44:13 +08:00
marvzhang	dc1b158afc	加入API Token后端	2020-04-20 11:43:58 +08:00
marvzhang	b0806d2e94	结果集自动生成	2020-04-19 17:49:21 +08:00
marvzhang	468ee7bda0	加入日志自动删除	2020-04-19 13:50:06 +08:00
marvzhang	e6ca540d11	优化日志插入	2020-04-19 11:29:50 +08:00
marvzhang	9e7a00e481	优化日志异常展示	2020-04-19 11:07:39 +08:00
marvzhang	7764b9fb82	加入日志异常检测	2020-04-19 10:32:36 +08:00
marvzhang	c7675ca40a	加入日志异常检测	2020-04-18 18:42:46 +08:00
marvzhang	9d7b42e295	优化日志分页	2020-04-18 16:06:38 +08:00
marvzhang	f640eb947d	优化日志	2020-04-16 13:54:22 +08:00
marvzhang	94e1d6c431	加入日志分页	2020-04-15 13:48:27 +08:00
marvzhang	63c95f8618	迁移日志到MongoDB	2020-04-01 16:52:23 +08:00
marvzhang	ea3a17f4bb	支持去重	2020-03-29 11:17:38 +08:00
marvzhang	e89e7ea755	优化主页指标展示	2020-03-22 09:25:54 +08:00
marvzhang	7e343cdde1	加入权限管理	2020-03-20 17:43:11 +08:00
marvzhang	3a40d0d2c7	加入ScheduleId到Task	2020-03-20 08:33:30 +08:00
marvzhang	e33dfd7992	加入挑战	2020-03-19 18:56:59 +08:00
marvzhang	e3a059eb7c	updated contributors	2020-03-19 11:13:25 +08:00
marvzhang	a88e90e025	用户挑战基础准备	2020-03-18 18:00:25 +08:00
zkqiang	4b45cbfd98	fixed GetNodeBaseInfo	2020-03-18 10:27:38 +08:00
marvzhang	a3326da0f5	加入hostname注册	2020-03-05 08:56:01 +08:00
marvzhang	9e24d22ee1	updated install-java.sh	2020-03-05 08:09:12 +08:00
marvzhang	8c059c912e	加入批量删除爬虫任务	2020-02-22 17:35:51 +08:00
marvzhang	e3883faf1c	优化爬虫列表页面	2020-02-20 11:52:28 +08:00
marvzhang	0cb2e8134c	加入Git同步	2020-02-18 12:15:40 +08:00
marvzhang	f83a041cd1	加入git同步	2020-02-17 18:12:59 +08:00
marvzhang	69e4c23115	更新scrapy参数	2020-02-16 10:38:41 +08:00
marvzhang	01fefbee88	加入scrapy日志选择	2020-02-15 21:25:21 +08:00
marvzhang	acdf4d5951	加入scrapy爬虫支持	2020-02-15 18:28:37 +08:00
marvzhang	12b03cba8a	fixed https://github.com/crawlab-team/crawlab/issues/524	2020-02-09 09:02:13 +08:00
marvzhang	5740774ccc	添加demo爬虫	2020-02-02 22:56:11 +08:00
marvzhang	024f9ac3b2	finish up project	2020-02-02 13:29:56 +08:00