45 Commits

Author	SHA1	Message	Date
Marvin Zhang	42daea50dd	fixed issue https://github.com/tikazyq/crawlab/issues/45	2019-05-30 12:22:17 +08:00
Marvin Zhang	4752efe11d	fixed issue https://github.com/tikazyq/crawlab/issues/45	2019-05-30 12:21:01 +08:00
Marvin Zhang	eb43e1f273	added baidu tongji for analytics	2019-05-29 22:06:43 +08:00
Marvin Zhang	68a2a9fa4e	Merge remote-tracking branch 'origin/develop' into develop ... # Conflicts: # frontend/src/views/spider/SpiderList.vue	2019-05-26 19:19:43 +08:00
Marvin Zhang	d3f776802e	updated configurable spider	2019-05-26 17:10:04 +08:00
Marvin Zhang	5477099f15	prepared for configurable spiders	2019-05-24 17:28:25 +08:00
Marvin Zhang	2fce5efab8	UI adjustment	2019-05-23 17:12:29 +08:00
Marvin Zhang	3c1d3a65ea	updated SiteList	2019-05-22 22:39:02 +08:00
Marvin Zhang	f63b58906e	updated SiteList	2019-05-22 22:33:43 +08:00
Marvin Zhang	c69c8e5f64	updated SiteList	2019-05-22 19:24:27 +08:00
Marvin Zhang	f96339cdcb	added i18n for tags-view	2019-05-22 13:02:14 +08:00
woshixiaoqianbi	2eb91123b0	restore router tag	2019-05-21 18:00:03 +08:00
Marvin Zhang	d7f8ee13de	添加robots.txt协议解析	2019-05-21 13:34:07 +08:00
Marvin Zhang	b7b89cf72d	added jd spider	2019-05-10 21:25:17 +08:00
Marvin Zhang	133f1197fd	link site to spider	2019-05-10 13:27:13 +08:00
Marvin Zhang	6a12dfe7b7	added site list	2019-05-09 22:28:12 +08:00
Marvin Zhang	4bd93db193	added site list	2019-05-09 22:14:37 +08:00
Marvin Zhang	a9f59dc110	added analytics for spider	2019-04-28 13:17:40 +08:00
Marvin Zhang	677d6e36a9	added stats for spider	2019-04-23 20:25:15 +08:00
Marvin Zhang	c342d81fe1	request task list every 5 seconds	2019-04-23 19:52:06 +08:00
Marvin Zhang	22fd9ba848	added filter for TaskList	2019-04-22 21:26:58 +08:00
Marvin Zhang	3407e4e8df	added params for spider schedules	2019-04-20 20:04:09 +08:00
Marvin Zhang	aa6f414e42	added filter for TaskList	2019-04-17 21:50:30 +08:00
Marvin Zhang	c48bb96b2f	updated ScheduleList	2019-04-17 13:25:14 +08:00
Marvin Zhang	a46b8e2270	updated ScheduleList	2019-04-17 13:23:28 +08:00
Marvin Zhang	aa9dcef9b6	added schedule functionality	2019-04-17 12:53:19 +08:00
Marvin Zhang	ffaccd67fd	added lianjia example	2019-04-16 20:19:22 +08:00
Marvin Zhang	d48fee0d03	enforce deploy before running a spider	2019-04-15 19:50:25 +08:00
Marvin Zhang	f004c1a70a	added environment variables for spider page	2019-04-10 22:16:25 +08:00
Marvin Zhang	563ecea96f	updated README.md ... code cleanup	2019-04-03 19:58:21 +08:00
cxa	61f7ff6a89	fix bug	2019-04-03 16:32:35 +08:00
Marvin Zhang	d44e5d2518	updated Multi Language for a few pages	2019-03-27 12:35:22 +08:00
Marvin Zhang	3af510a417	updated Multi Language for a few pages	2019-03-26 19:33:03 +08:00
Marvin Zhang	9a7ade8e6e	added Multi Language support	2019-03-23 23:48:08 +08:00
Marvin Zhang	6ed8a449ce	changed the way how task is saved to database	2019-03-13 21:33:47 +08:00
Marvin Zhang	17c605ebd4	added pagination for tasks results	2019-03-12 21:20:22 +08:00
Marvin Zhang	4081899e71	added pagination for tasks	2019-03-12 21:01:14 +08:00
Marvin Zhang	849a812e23	added pagination for tasks	2019-03-12 21:00:35 +08:00
Marvin Zhang	508712ba07	fixed inconsistency of timestamp issue	2019-03-12 20:28:50 +08:00
Marvin Zhang	cc4a0eefc3	added cron tasks for spiders	2019-03-09 14:05:14 +08:00
Marvin Zhang	1fb09e4d1f	support multi-node log view	2019-03-06 15:43:14 +08:00
Marvin Zhang	a31893b48a	added Results	2019-03-06 13:14:26 +08:00
Marvin Zhang	de3247269c	updated methodologies of deployment and running spider	2019-03-05 13:22:23 +08:00
Marvin Zhang	95cf526013	added github import	2019-03-04 12:07:14 +08:00
Marvin Zhang	cc59e1cfce	added setup.py	2019-03-03 10:48:04 +08:00