105 Commits

Author	SHA1	Message	Date
Marvin Zhang	27f2e42116	fix: dependency issue	2024-06-14 16:51:09 +08:00
Marvin Zhang	1e4a6f9e07	code cleanup	2022-02-21 09:40:00 +08:00
marvzhang	1c0aba161c	added cli	2021-04-27 11:34:12 +08:00
marvzhang	4ceb2d173e	renamed modules	2021-04-07 11:25:00 +08:00
marvzhang	9b947c6d56	refactoring	2021-03-23 22:50:19 +08:00
marvzhang	2cf84b81ae	code cleanup	2020-12-04 15:33:15 +08:00
marvzhang	d525099568	added part of the system tasks logic	2020-07-30 23:06:11 +08:00
marvzhang	4cca9cf80f	fixed https://github.com/crawlab-team/crawlab/issues/811	2020-07-26 10:40:23 +08:00
marvzhang	aa7706f2ab	added batch enable/disable schedules	2020-07-18 21:16:28 +08:00
marvzhang	695bd3ddf5	added batch delete schedules	2020-07-18 12:48:21 +08:00
marvzhang	04757bfe06	added batch add schedules	2020-07-18 12:28:25 +08:00
marvzhang	478fbd1759	added batch restart tasks	2020-07-18 11:33:07 +08:00
marvzhang	00ef72f6e8	added batch stop tasks	2020-07-18 11:26:09 +08:00
marvzhang	31c3c91545	added batch run tasks	2020-07-17 15:58:55 +08:00
marvzhang	a3d82c40c0	added spider market	2020-07-13 16:56:11 +08:00
yaziming	eed50ba38f	修复子节点不能先注册的问题	2020-06-02 15:32:25 +08:00
yaziming	93c06d0464	解决节点不存在时，无法主动创建master节点的问题	2020-05-27 19:04:54 +08:00
yaziming	53b30e5676	local node	2020-05-26 16:15:05 +08:00
yaziming	ff9c9d57ef	增加当前节点本地定时缓存，修改部分潜在BUG，启动时Mongo或者redis无法正常连接时，进入启动等待	2020-05-23 15:15:39 +08:00
yaziming	fb07fbffc0	1	2020-05-19 00:06:04 +08:00
yaziming	1b602d4e24	refactor(backend): Upgrade the version that depends on the library gin ... Upgrade the version that depends on the library gin	2020-05-09 17:18:10 +08:00
hantmac	f59ca2b605	Add swagger docs	2020-05-01 23:11:51 +08:00
hantmac	b109662466	support crawlab runtime log to ES	2020-04-27 17:18:57 +08:00
marvzhang	dc1b158afc	加入API Token后端	2020-04-20 11:43:58 +08:00
marvzhang	7764b9fb82	加入日志异常检测	2020-04-19 10:32:36 +08:00
marvzhang	63c95f8618	迁移日志到MongoDB	2020-04-01 16:52:23 +08:00
marvzhang	9ac1bfc588	加入重试	2020-03-29 15:45:25 +08:00
marvzhang	7e343cdde1	加入权限管理	2020-03-20 17:43:11 +08:00
marvzhang	e33dfd7992	加入挑战	2020-03-19 18:56:59 +08:00
marvzhang	e3a059eb7c	updated contributors	2020-03-19 11:13:25 +08:00
marvzhang	a88e90e025	用户挑战基础准备	2020-03-18 18:00:25 +08:00
marvzhang	fa94034311	加入Git Checkout ... 功能	2020-03-11 15:18:42 +08:00
marvzhang	03d74ddd14	加入git 日志	2020-03-11 14:01:02 +08:00
marvzhang	b167107b5c	加入配置只在工作节点上调度	2020-03-11 08:05:37 +08:00
marvzhang	e5b4ac6310	重构RPC逻辑	2020-03-10 12:08:26 +08:00
marvzhang	2712d7207d	加入帮助文档	2020-03-01 20:55:52 +08:00
marvzhang	57f1edc207	updated dockerpush.yml	2020-02-23 09:19:18 +08:00
marvzhang	7a75e643ea	加入批量运行爬虫	2020-02-22 19:12:24 +08:00
marvzhang	8c059c912e	加入批量删除爬虫任务	2020-02-22 17:35:51 +08:00
marvzhang	15ea0da0f3	加入批量删除爬虫	2020-02-22 12:44:58 +08:00
marvzhang	a346b64bdc	加入scrapy spider跳转	2020-02-21 22:28:41 +08:00
marvzhang	d7437c4eb1	加入scrapy pipelines支持	2020-02-21 17:12:57 +08:00
marvzhang	d931f9af8e	加入scrapy items.py支持	2020-02-21 15:07:54 +08:00
marvzhang	e4c012cf2f	加入版本检测	2020-02-19 13:16:46 +08:00
marvzhang	0cb2e8134c	加入Git同步	2020-02-18 12:15:40 +08:00
marvzhang	f83a041cd1	加入git同步	2020-02-17 18:12:59 +08:00
marvzhang	bb972e98ef	加入添加scrapy爬虫	2020-02-17 14:06:16 +08:00
marvzhang	dc38642dca	加入settings.py同步	2020-02-17 11:15:16 +08:00
marvzhang	cdaf3363c8	添加Scrapy设置后端	2020-02-17 10:31:59 +08:00
marvzhang	01fefbee88	加入scrapy日志选择	2020-02-15 21:25:21 +08:00