167 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
woshixiaoqianbi	b5dc9ca30d	restore router tag	2019-05-21 18:00:03 +08:00
Marvin Zhang	97752ba705	添加robots.txt协议解析	2019-05-21 13:34:07 +08:00
Marvin Zhang	1a19aac4f8	Merge remote-tracking branch 'origin/develop' into develop	2019-05-21 12:28:59 +08:00
Marvin Zhang	1f015730c1	refactor code	2019-05-21 12:28:33 +08:00
Marvin Zhang	02aec91118	Update README-zh.md	2019-05-21 10:11:17 +08:00
Marvin Zhang	b94c8057de	Update README.md	2019-05-21 10:08:55 +08:00
Marvin Zhang	0fbd3a5026	Create LICENSE	2019-05-17 09:35:40 +08:00
Marvin Zhang	bc4a04bc6c	updated version	2019-05-10 21:25:51 +08:00
Marvin Zhang	73e3bc2dec	added jd spider	2019-05-10 21:25:17 +08:00
Marvin Zhang	433b945eeb	link site to spider	2019-05-10 13:27:13 +08:00
Marvin Zhang	1cd2fd47f3	link site to spider	2019-05-10 13:26:58 +08:00
Marvin Zhang	69e2e2f3c5	added chinaz spider	2019-05-10 12:39:10 +08:00
Marvin Zhang	93f9612b9b	added site list	2019-05-09 22:28:12 +08:00
Marvin Zhang	e822c65eb2	added site list	2019-05-09 22:15:58 +08:00
Marvin Zhang	0ad0303285	added site list	2019-05-09 22:14:37 +08:00
Marvin Zhang	e3d4796d8a	added chinaz spider	2019-05-09 20:52:59 +08:00
Marvin Zhang	34871213d5	fixed translation typo	2019-05-09 19:46:49 +08:00
Marvin Zhang	4cdacf23e2	fixed pymongo connection issue	2019-05-09 19:44:47 +08:00
Marvin Zhang	c2771c743a	fixed pymongo connection issue	2019-05-09 19:43:02 +08:00
Marvin Zhang	248fc9fa1a	fixed analytics issue	2019-05-08 12:35:13 +08:00
Marvin Zhang	c96dd102d9	updated analytics for spider	2019-04-28 21:25:32 +08:00
Marvin Zhang	21f7864c68	updated analytics for spider	2019-04-28 21:16:31 +08:00
Marvin Zhang	9bd819c384	updated analytics for spider	2019-04-28 19:52:10 +08:00
Marvin Zhang	60d658de5f	updated analytics for spider	2019-04-28 19:41:44 +08:00
Marvin Zhang	8a34aae3e6	updated stats for spider	2019-04-28 19:38:17 +08:00
Marvin Zhang	2445868102	updated stats for spider	2019-04-28 19:37:48 +08:00
Marvin Zhang	c497cf2c8b	updated stats for spider	2019-04-28 19:32:23 +08:00
Marvin Zhang	efc32886ae	updated analytics for spider	2019-04-28 19:32:18 +08:00
Marvin Zhang	70d392ef62	updated analytics for spider	2019-04-28 19:24:03 +08:00
Marvin Zhang	16a958a6e4	updated stats for spider	2019-04-28 19:23:21 +08:00
Marvin Zhang	21ac672564	added stats for spider	2019-04-28 13:18:03 +08:00
Marvin Zhang	a41415a041	added analytics for spider	2019-04-28 13:17:40 +08:00
Marvin Zhang	cee9ef6ba9	added virtualenv to python executable	2019-04-26 12:36:31 +08:00
Marvin Zhang	ae29708d99	request task list every 5 seconds	2019-04-23 20:36:31 +08:00
Marvin Zhang	b7ed4ad442	added stats for spider	2019-04-23 20:25:15 +08:00
Marvin Zhang	db0f58f9b9	request task list every 5 seconds	2019-04-23 19:52:06 +08:00
Marvin Zhang	4726f6ca4d	fix issue #12	2019-04-23 19:40:33 +08:00
Marvin Zhang	db1cd7ec9b	fix issue #12	2019-04-23 19:33:50 +08:00
Marvin Zhang	4dff16e9ec	added filter for TaskList	2019-04-22 21:26:58 +08:00
Marvin Zhang	017116bb29	added results stats for tasks	2019-04-22 21:06:08 +08:00
Marvin Zhang	6317c9ca1a	Merge remote-tracking branch 'origin/develop' into develop	2019-04-20 20:05:00 +08:00
Marvin Zhang	9a00be811e	added params for spider schedules	2019-04-20 20:04:09 +08:00
Marvin Zhang	ba09cb6e89	Merge pull request #22 from casperwnb/develop ... Develop	2019-04-19 13:48:18 +08:00
casperwnb	acc606cf21	Merge remote-tracking branch 'upstream/master' into develop	2019-04-19 12:34:48 +08:00
casperwnb	7fb2cf5edc	Merge remote-tracking branch 'upstream/develop' into develop	2019-04-19 12:34:35 +08:00
casperwnb	31b8418d4e	Merge branch 'develop' of https://github.com/casperwnb/crawlab into develop	2019-04-19 12:11:25 +08:00
casperwnb	4b4c486491	modify config setting	2019-04-19 11:35:14 +08:00
Marvin Zhang	82ac9bec72	updated scheduler	2019-04-17 22:07:48 +08:00
Marvin Zhang	daeaa05d85	added filter for TaskList	2019-04-17 21:50:30 +08:00
Marvin Zhang	c0a987dad1	updated cron schedule logic	2019-04-17 21:22:02 +08:00