605 Commits

Author	SHA1	Message	Date
marvzhang	bbd77a43f0	optimized code	2021-04-29 11:35:39 +08:00
marvzhang	15bd38f598	updated code structure	2021-04-29 10:44:46 +08:00
marvzhang	d5141f723a	updated cli	2021-04-27 17:37:29 +08:00
marvzhang	6e9078e2ce	updated description	2021-04-27 11:37:18 +08:00
marvzhang	be5a2207fd	added cli	2021-04-27 11:34:12 +08:00
marvzhang	98913cd3aa	fixed namings	2021-04-20 13:20:51 +08:00
marvzhang	f5ec1ad586	renaming	2021-04-08 13:21:04 +08:00
marvzhang	b3c44cec3d	renamed modules	2021-04-07 11:25:00 +08:00
marvzhang	867093ae4e	refactoring	2021-03-23 22:50:19 +08:00
marvzhang	787e310d18	updated config.yml	2021-02-18 10:03:48 +08:00
marvzhang	074ddf6e45	code cleanup	2020-12-04 15:38:26 +08:00
marvzhang	00cf719ecc	code cleanup	2020-12-04 15:33:15 +08:00
marvzhang	c83b331101	Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop	2020-10-12 15:35:32 +08:00
marvzhang	a8bae41282	added ruby install script	2020-10-12 15:32:48 +08:00
zkqiang	77f7e889ba	fixed build error of windows	2020-09-20 12:35:21 +08:00
gemer	18fb8a6d9e	add backend install script execute privilege and fixed nodejs with unbunu deprecated libssl1.0-dev	2020-09-16 11:44:41 +08:00
marvzhang	9391334152	updated template spiders	2020-08-13 10:11:34 +08:00
marvzhang	f14e7124d4	added colly example	2020-08-13 09:23:34 +08:00
marvzhang	afc9a6ca48	updated baidu_colly spider	2020-08-03 17:38:01 +08:00
marvzhang	c2e90bc6d1	added baidu colly example spider	2020-08-03 16:20:33 +08:00
marvzhang	0a292248b4	added system tasks	2020-07-31 13:13:49 +08:00
marvzhang	12009a387c	added todos	2020-07-30 23:09:18 +08:00
marvzhang	154813ceff	added part of the system tasks logic	2020-07-30 23:06:11 +08:00
marvzhang	d2338ce6a7	updated install-chromedriver.sh	2020-07-30 14:54:07 +08:00
marvzhang	98223d8e38	added firefox	2020-07-30 14:15:15 +08:00
marvzhang	5486714f19	added lock files	2020-07-30 12:03:04 +08:00
marvzhang	375d7a96da	added chromedriver	2020-07-30 12:02:11 +08:00
marvzhang	b08fcc77da	added golang	2020-07-30 11:12:36 +08:00
marvzhang	75afc64e39	fixed https://github.com/crawlab-team/crawlab/issues/813	2020-07-26 18:28:50 +08:00
marvzhang	1b6d790d30	fixed https://github.com/crawlab-team/crawlab/issues/814	2020-07-26 18:00:28 +08:00
marvzhang	9616ba54c7	fixed https://github.com/crawlab-team/crawlab/issues/813	2020-07-26 17:38:12 +08:00
marvzhang	e202bd2b16	fixed https://github.com/crawlab-team/crawlab/issues/811	2020-07-26 10:40:23 +08:00
marvzhang	91e084a6a3	fixed https://github.com/crawlab-team/crawlab/issues/808	2020-07-20 21:52:32 +08:00
marvzhang	bce5ad8a0f	updated node offline task update	2020-07-18 22:13:05 +08:00
marvzhang	789b04b3ee	added restart in task detail	2020-07-18 21:44:39 +08:00
marvzhang	b2dc58a592	updated node offline task update	2020-07-18 21:35:54 +08:00
marvzhang	5bcf2b13d8	added batch enable/disable schedules	2020-07-18 21:16:28 +08:00
marvzhang	8a1776deb9	added batch delete schedules	2020-07-18 12:48:21 +08:00
marvzhang	16f174411d	added batch add schedules	2020-07-18 12:28:25 +08:00
marvzhang	b1c5ffc540	added batch restart tasks	2020-07-18 11:33:07 +08:00
marvzhang	af420972ed	added batch stop tasks	2020-07-18 11:26:09 +08:00
marvzhang	9c0f8be516	added batch set projects	2020-07-18 10:58:06 +08:00
marvzhang	9d69b87312	added batch run tasks	2020-07-17 15:58:55 +08:00
marvzhang	2263332712	Merge branch 'develop' of github.com:crawlab-team/crawlab into develop	2020-07-15 11:19:38 +08:00
marvzhang	ccce1eb951	added spider market	2020-07-13 16:56:11 +08:00
zkqiang	72eea9589a	fix stdout reader	2020-07-11 20:55:05 +08:00
marvzhang	63a24089c6	Merge remote-tracking branch 'origin/develop' into develop	2020-07-08 11:37:19 +08:00
marvzhang	8a2b7df148	fixed worker node failure issue	2020-07-08 11:36:35 +08:00
Marvin Zhang	d19aa1ac95	Merge pull request #803 from Seven2Nine/master ... Update spider.py	2020-07-08 11:22:59 +08:00
Seven2Nine	a7d3ca3bd3	Update spider.py ... 修复“//” 开头的url报错 ValueError('Missing scheme in request url: %s' % self._url)	2020-07-08 11:06:52 +08:00