19 Commits

Author	SHA1	Message	Date
Marvin Zhang	841b5d95d9	updated SiteList	2019-05-22 19:24:27 +08:00
Marvin Zhang	97752ba705	添加robots.txt协议解析	2019-05-21 13:34:07 +08:00
Marvin Zhang	73e3bc2dec	added jd spider	2019-05-10 21:25:17 +08:00
Marvin Zhang	93f9612b9b	added site list	2019-05-09 22:28:12 +08:00
Marvin Zhang	e822c65eb2	added site list	2019-05-09 22:15:58 +08:00
Marvin Zhang	34871213d5	fixed translation typo	2019-05-09 19:46:49 +08:00
Marvin Zhang	9bd819c384	updated analytics for spider	2019-04-28 19:52:10 +08:00
Marvin Zhang	a41415a041	added analytics for spider	2019-04-28 13:17:40 +08:00
Marvin Zhang	b7ed4ad442	added stats for spider	2019-04-23 20:25:15 +08:00
Marvin Zhang	4dff16e9ec	added filter for TaskList	2019-04-22 21:26:58 +08:00
Marvin Zhang	9a00be811e	added params for spider schedules	2019-04-20 20:04:09 +08:00
Marvin Zhang	b169f09e12	added lianjia example	2019-04-16 20:19:22 +08:00
Marvin Zhang	63ff2d1894	enforce deploy before running a spider	2019-04-15 19:50:25 +08:00
Marvin Zhang	6712b3a5f1	added environment variables for spider page	2019-04-10 22:16:25 +08:00
Marvin Zhang	7ce74e06d7	updated README.md ... code cleanup	2019-04-03 19:58:21 +08:00
cxa	df43a7fc96	fix bug	2019-04-03 16:32:35 +08:00
Marvin Zhang	063703319c	updated Multi Language for a few pages	2019-03-27 12:35:22 +08:00
Marvin Zhang	1efc5199f9	updated Multi Language for a few pages	2019-03-26 19:33:03 +08:00
Marvin Zhang	d6cd8ff8f7	added Multi Language support	2019-03-23 23:48:08 +08:00