588 Commits

Author	SHA1	Message	Date
marvzhang	46a30d925c	added colly example	2020-08-13 09:23:34 +08:00
marvzhang	e3fc3acc8b	updated baidu_colly spider	2020-08-03 17:38:01 +08:00
marvzhang	bf2943e098	added baidu colly example spider	2020-08-03 16:20:33 +08:00
marvzhang	74f7f59036	added system tasks	2020-07-31 13:13:49 +08:00
marvzhang	0205dc5f11	added todos	2020-07-30 23:09:18 +08:00
marvzhang	d525099568	added part of the system tasks logic	2020-07-30 23:06:11 +08:00
marvzhang	ec81344e20	updated install-chromedriver.sh	2020-07-30 14:54:07 +08:00
marvzhang	d24b31f6bd	added firefox	2020-07-30 14:15:15 +08:00
marvzhang	c8ae849dd1	added lock files	2020-07-30 12:03:04 +08:00
marvzhang	596a2a7e4d	added chromedriver	2020-07-30 12:02:11 +08:00
marvzhang	27fd16f345	added golang	2020-07-30 11:12:36 +08:00
marvzhang	0a75b359f5	fixed https://github.com/crawlab-team/crawlab/issues/813	2020-07-26 18:28:50 +08:00
marvzhang	bbca5efa4b	fixed https://github.com/crawlab-team/crawlab/issues/814	2020-07-26 18:00:28 +08:00
marvzhang	8a434e0019	fixed https://github.com/crawlab-team/crawlab/issues/813	2020-07-26 17:38:12 +08:00
marvzhang	4cca9cf80f	fixed https://github.com/crawlab-team/crawlab/issues/811	2020-07-26 10:40:23 +08:00
marvzhang	5585bc56f0	fixed https://github.com/crawlab-team/crawlab/issues/808	2020-07-20 21:52:32 +08:00
marvzhang	6c098c7095	updated node offline task update	2020-07-18 22:13:05 +08:00
marvzhang	d63c89d447	added restart in task detail	2020-07-18 21:44:39 +08:00
marvzhang	1fbed2679d	updated node offline task update	2020-07-18 21:35:54 +08:00
marvzhang	aa7706f2ab	added batch enable/disable schedules	2020-07-18 21:16:28 +08:00
marvzhang	695bd3ddf5	added batch delete schedules	2020-07-18 12:48:21 +08:00
marvzhang	04757bfe06	added batch add schedules	2020-07-18 12:28:25 +08:00
marvzhang	478fbd1759	added batch restart tasks	2020-07-18 11:33:07 +08:00
marvzhang	00ef72f6e8	added batch stop tasks	2020-07-18 11:26:09 +08:00
marvzhang	d973aa39a7	added batch set projects	2020-07-18 10:58:06 +08:00
marvzhang	31c3c91545	added batch run tasks	2020-07-17 15:58:55 +08:00
marvzhang	23166275e2	Merge branch 'develop' of github.com:crawlab-team/crawlab into develop	2020-07-15 11:19:38 +08:00
marvzhang	a3d82c40c0	added spider market	2020-07-13 16:56:11 +08:00
zkqiang	71b51a11e6	fix stdout reader	2020-07-11 20:55:05 +08:00
marvzhang	c54be2a83e	Merge remote-tracking branch 'origin/develop' into develop	2020-07-08 11:37:19 +08:00
marvzhang	f09d9b3e6e	fixed worker node failure issue	2020-07-08 11:36:35 +08:00
Marvin Zhang	0ad98fc427	Merge pull request #803 from Seven2Nine/master ... Update spider.py	2020-07-08 11:22:59 +08:00
Seven2Nine	142367a5f0	Update spider.py ... 修复“//” 开头的url报错 ValueError('Missing scheme in request url: %s' % self._url)	2020-07-08 11:06:52 +08:00
marvzhang	8399597d2f	Merge remote-tracking branch 'origin/develop' into develop	2020-07-08 10:26:23 +08:00
marvzhang	2abb450574	fixed git issue	2020-07-08 10:25:58 +08:00
yaziming	d1ec6160c1	Merge pull request #801 from yaziming/fix/fix-scan-zero-values ... fix-scan-error	2020-07-07 14:37:55 +08:00
yaziming	5ba7d4d883	fix-scan-error	2020-07-07 14:26:24 +08:00
zkqiang	0f4edca6d1	compatible with go1.12	2020-07-04 12:14:56 +08:00
marvzhang	13e8da9cda	fixed https://github.com/crawlab-team/crawlab/issues/787	2020-07-03 17:28:07 +08:00
marvzhang	14ab3b9208	fixed worker node unable to register issue	2020-07-02 12:07:07 +08:00
marvzhang	468497ddc5	fixed git integration error	2020-07-01 15:13:51 +08:00
marvzhang	1cada25601	Merge remote-tracking branch 'origin/develop' into develop	2020-06-30 22:20:30 +08:00
marvzhang	65c3345801	try to fix re-upload error	2020-06-30 22:07:00 +08:00
marvzhang	7dc7932abd	fixed unable to view task issue	2020-06-30 21:45:19 +08:00
yaziming	04a94d2546	开发Docker环境	2020-06-19 16:11:19 +08:00
marvzhang	c4143399e5	added error notification for scrapy spiders	2020-06-18 12:54:12 +08:00
marvzhang	7551f28b71	fixed unable to call task issues	2020-06-18 10:53:50 +08:00
marvzhang	a20e849fc3	fixed unable to call task issues	2020-06-18 09:50:10 +08:00
marvzhang	8d0997fdc1	Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop	2020-06-07 21:30:01 +08:00
marvzhang	144769d86e	set default log expire time to 1 day	2020-06-07 21:29:28 +08:00