839 Commits

Author	SHA1	Message	Date
marvzhang	9391334152	updated template spiders	2020-08-13 10:11:34 +08:00
marvzhang	f14e7124d4	added colly example	2020-08-13 09:23:34 +08:00
marvzhang	afc9a6ca48	updated baidu_colly spider	2020-08-03 17:38:01 +08:00
marvzhang	c2e90bc6d1	added baidu colly example spider	2020-08-03 16:20:33 +08:00
marvzhang	0a292248b4	added system tasks	2020-07-31 13:13:49 +08:00
marvzhang	12009a387c	added todos	2020-07-30 23:09:18 +08:00
marvzhang	154813ceff	added part of the system tasks logic	2020-07-30 23:06:11 +08:00
marvzhang	d2338ce6a7	updated install-chromedriver.sh	2020-07-30 14:54:07 +08:00
marvzhang	98223d8e38	added firefox	2020-07-30 14:15:15 +08:00
marvzhang	5486714f19	added lock files	2020-07-30 12:03:04 +08:00
marvzhang	375d7a96da	added chromedriver	2020-07-30 12:02:11 +08:00
marvzhang	b08fcc77da	added golang	2020-07-30 11:12:36 +08:00
marvzhang	75afc64e39	fixed https://github.com/crawlab-team/crawlab/issues/813	2020-07-26 18:28:50 +08:00
marvzhang	1b6d790d30	fixed https://github.com/crawlab-team/crawlab/issues/814	2020-07-26 18:00:28 +08:00
marvzhang	9616ba54c7	fixed https://github.com/crawlab-team/crawlab/issues/813	2020-07-26 17:38:12 +08:00
marvzhang	e202bd2b16	fixed https://github.com/crawlab-team/crawlab/issues/811	2020-07-26 10:40:23 +08:00
marvzhang	91e084a6a3	fixed https://github.com/crawlab-team/crawlab/issues/808	2020-07-20 21:52:32 +08:00
marvzhang	bce5ad8a0f	updated node offline task update	2020-07-18 22:13:05 +08:00
marvzhang	789b04b3ee	added restart in task detail	2020-07-18 21:44:39 +08:00
marvzhang	b2dc58a592	updated node offline task update	2020-07-18 21:35:54 +08:00
marvzhang	5bcf2b13d8	added batch enable/disable schedules	2020-07-18 21:16:28 +08:00
marvzhang	8a1776deb9	added batch delete schedules	2020-07-18 12:48:21 +08:00
marvzhang	16f174411d	added batch add schedules	2020-07-18 12:28:25 +08:00
marvzhang	b1c5ffc540	added batch restart tasks	2020-07-18 11:33:07 +08:00
marvzhang	af420972ed	added batch stop tasks	2020-07-18 11:26:09 +08:00
marvzhang	9c0f8be516	added batch set projects	2020-07-18 10:58:06 +08:00
marvzhang	9d69b87312	added batch run tasks	2020-07-17 15:58:55 +08:00
marvzhang	2263332712	Merge branch 'develop' of github.com:crawlab-team/crawlab into develop	2020-07-15 11:19:38 +08:00
marvzhang	ccce1eb951	added spider market	2020-07-13 16:56:11 +08:00
zkqiang	72eea9589a	fix stdout reader	2020-07-11 20:55:05 +08:00
marvzhang	63a24089c6	Merge remote-tracking branch 'origin/develop' into develop	2020-07-08 11:37:19 +08:00
marvzhang	8a2b7df148	fixed worker node failure issue	2020-07-08 11:36:35 +08:00
Marvin Zhang	d19aa1ac95	Merge pull request #803 from Seven2Nine/master ... Update spider.py	2020-07-08 11:22:59 +08:00
Seven2Nine	a7d3ca3bd3	Update spider.py ... 修复“//” 开头的url报错 ValueError('Missing scheme in request url: %s' % self._url)	2020-07-08 11:06:52 +08:00
marvzhang	6672b227a5	Merge remote-tracking branch 'origin/develop' into develop	2020-07-08 10:26:23 +08:00
marvzhang	63747af427	fixed git issue	2020-07-08 10:25:58 +08:00
yaziming	7081c770c6	Merge pull request #801 from yaziming/fix/fix-scan-zero-values ... fix-scan-error	2020-07-07 14:37:55 +08:00
yaziming	1ae5bf8f08	fix-scan-error	2020-07-07 14:26:24 +08:00
zkqiang	78cc9cb99c	compatible with go1.12	2020-07-04 12:14:56 +08:00
marvzhang	ac9a36d4a1	fixed https://github.com/crawlab-team/crawlab/issues/787	2020-07-03 17:28:07 +08:00
marvzhang	ffe9d5f6b6	fixed worker node unable to register issue	2020-07-02 12:07:07 +08:00
marvzhang	5130396da6	fixed git integration error	2020-07-01 15:13:51 +08:00
marvzhang	222f3e9ec3	Merge remote-tracking branch 'origin/develop' into develop	2020-06-30 22:20:30 +08:00
marvzhang	4ddb083a23	try to fix re-upload error	2020-06-30 22:07:00 +08:00
marvzhang	729e4a263c	fixed unable to view task issue	2020-06-30 21:45:19 +08:00
yaziming	e7ff02589b	开发Docker环境	2020-06-19 16:11:19 +08:00
marvzhang	3ff96a237a	added error notification for scrapy spiders	2020-06-18 12:54:12 +08:00
marvzhang	6a1c09bb46	fixed unable to call task issues	2020-06-18 10:53:50 +08:00
marvzhang	61ac23dcd4	fixed unable to call task issues	2020-06-18 09:50:10 +08:00
marvzhang	4a142e1ac8	Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop	2020-06-07 21:30:01 +08:00