59 Commits

Author	SHA1	Message	Date
Marvin Zhang	92db616419	updated crontab	2019-06-17 13:18:51 +08:00
Marvin Zhang	c4ced4316e	updated crontab	2019-06-17 13:14:51 +08:00
Marvin Zhang	67a82f0370	updated crontab	2019-06-17 13:06:47 +08:00
Marvin Zhang	8e3d7be5ad	updated crontab	2019-06-17 13:04:29 +08:00
Marvin Zhang	aa3911f9fa	updated crontab	2019-06-17 13:04:17 +08:00
Marvin Zhang	ab1dcf45ef	updated crontab	2019-06-17 13:01:20 +08:00
Marvin Zhang	aceeae84e8	added virtual scroll list for log view	2019-06-09 19:06:37 +08:00
Marvin Zhang	74cd9f835e	added upload functionality	2019-06-04 21:15:54 +08:00
Marvin Zhang	8dbc4911d4	added upload functionality	2019-06-04 20:45:56 +08:00
Marvin Zhang	a1ee97ce6b	fixed send user stats issue	2019-06-04 20:26:33 +08:00
Marvin Zhang	9148e31afe	added pagination for SpiderList	2019-06-04 13:40:37 +08:00
Marvin Zhang	c0cec217d7	updated auto field extraction	2019-06-04 07:55:51 +08:00
Marvin Zhang	a27cef6868	burying points for analytics	2019-05-30 21:14:30 +08:00
Marvin Zhang	2a8e33d3c7	download results	2019-05-30 13:07:09 +08:00
Marvin Zhang	c4c1777844	fixed issue https://github.com/tikazyq/crawlab/issues/45	2019-05-30 12:22:17 +08:00
Marvin Zhang	571acd9728	fixed issue https://github.com/tikazyq/crawlab/issues/45	2019-05-30 12:21:01 +08:00
Marvin Zhang	0b406937c9	added baidu tongji for analytics	2019-05-29 22:06:43 +08:00
Marvin Zhang	8d3d7b3869	Merge remote-tracking branch 'origin/develop' into develop ... # Conflicts: # frontend/src/views/spider/SpiderList.vue	2019-05-26 19:19:43 +08:00
Marvin Zhang	5daebcb39b	updated configurable spider	2019-05-26 17:10:04 +08:00
Marvin Zhang	04789febc8	prepared for configurable spiders	2019-05-24 17:28:25 +08:00
Marvin Zhang	1ec23af3e1	UI adjustment	2019-05-23 17:12:29 +08:00
Marvin Zhang	d3ed3694a6	updated SiteList	2019-05-22 22:39:02 +08:00
Marvin Zhang	c5a3d32579	updated SiteList	2019-05-22 22:33:43 +08:00
Marvin Zhang	841b5d95d9	updated SiteList	2019-05-22 19:24:27 +08:00
Marvin Zhang	366ec7d857	added i18n for tags-view	2019-05-22 13:02:14 +08:00
woshixiaoqianbi	b5dc9ca30d	restore router tag	2019-05-21 18:00:03 +08:00
Marvin Zhang	97752ba705	添加robots.txt协议解析	2019-05-21 13:34:07 +08:00
Marvin Zhang	73e3bc2dec	added jd spider	2019-05-10 21:25:17 +08:00
Marvin Zhang	433b945eeb	link site to spider	2019-05-10 13:27:13 +08:00
Marvin Zhang	93f9612b9b	added site list	2019-05-09 22:28:12 +08:00
Marvin Zhang	0ad0303285	added site list	2019-05-09 22:14:37 +08:00
Marvin Zhang	a41415a041	added analytics for spider	2019-04-28 13:17:40 +08:00
Marvin Zhang	b7ed4ad442	added stats for spider	2019-04-23 20:25:15 +08:00
Marvin Zhang	db0f58f9b9	request task list every 5 seconds	2019-04-23 19:52:06 +08:00
Marvin Zhang	4dff16e9ec	added filter for TaskList	2019-04-22 21:26:58 +08:00
Marvin Zhang	9a00be811e	added params for spider schedules	2019-04-20 20:04:09 +08:00
Marvin Zhang	daeaa05d85	added filter for TaskList	2019-04-17 21:50:30 +08:00
Marvin Zhang	20c721a20e	updated ScheduleList	2019-04-17 13:25:14 +08:00
Marvin Zhang	7a41c68982	updated ScheduleList	2019-04-17 13:23:28 +08:00
Marvin Zhang	8bad2c49b1	added schedule functionality	2019-04-17 12:53:19 +08:00
Marvin Zhang	b169f09e12	added lianjia example	2019-04-16 20:19:22 +08:00
Marvin Zhang	63ff2d1894	enforce deploy before running a spider	2019-04-15 19:50:25 +08:00
Marvin Zhang	6712b3a5f1	added environment variables for spider page	2019-04-10 22:16:25 +08:00
Marvin Zhang	7ce74e06d7	updated README.md ... code cleanup	2019-04-03 19:58:21 +08:00
cxa	df43a7fc96	fix bug	2019-04-03 16:32:35 +08:00
Marvin Zhang	063703319c	updated Multi Language for a few pages	2019-03-27 12:35:22 +08:00
Marvin Zhang	1efc5199f9	updated Multi Language for a few pages	2019-03-26 19:33:03 +08:00
Marvin Zhang	d6cd8ff8f7	added Multi Language support	2019-03-23 23:48:08 +08:00
Marvin Zhang	53a80046d1	changed the way how task is saved to database	2019-03-13 21:33:47 +08:00
Marvin Zhang	1ec3074012	added pagination for tasks results	2019-03-12 21:20:22 +08:00