99 Commits

Author	SHA1	Message	Date
Marvin Zhang	549616c1e8	download results	2019-05-30 13:22:42 +08:00
Marvin Zhang	a441a7fddd	download results	2019-05-30 13:09:15 +08:00
Marvin Zhang	86e4bc82ba	download results	2019-05-30 13:07:03 +08:00
Marvin Zhang	43af8dc528	fixed issue https://github.com/tikazyq/crawlab/issues/45	2019-05-30 12:21:10 +08:00
Marvin Zhang	1bbf845dae	default Flask DEBUG = False	2019-05-29 22:07:49 +08:00
Marvin Zhang	558b7472f8	fixed bugs	2019-05-29 19:34:51 +08:00
Marvin Zhang	543fe61445	added automatic extraction of fields functionality	2019-05-29 18:02:54 +08:00
Marvin Zhang	2e2b65f691	added automatic extraction of fields functionality	2019-05-29 17:50:34 +08:00
Marvin Zhang	e67e356a4b	Merge remote-tracking branch 'origin/develop' into develop	2019-05-29 14:45:30 +08:00
Marvin Zhang	41661892cf	prepare for list fields extraction	2019-05-29 13:44:29 +08:00
Marvin Zhang	d7c6680ee4	prepare for list fields extraction	2019-05-29 13:43:03 +08:00
Marvin Zhang	e570bcfa13	prepare for list fields extraction	2019-05-29 13:33:05 +08:00
Marvin Zhang	87c81deefb	code cleanup	2019-05-29 13:10:31 +08:00
Marvin Zhang	d130b0a04c	updated README	2019-05-29 12:40:36 +08:00
Marvin Zhang	fc4b118174	updated requirements.txt	2019-05-29 12:09:10 +08:00
Marvin Zhang	1f458a96e2	updated requirements.txt	2019-05-29 12:06:24 +08:00
Marvin Zhang	f710d327b1	allow generate URLs by pattern	2019-05-28 14:59:21 +08:00
Marvin Zhang	dec76bbca9	compatibility issue with win32	2019-05-28 14:22:45 +08:00
Marvin Zhang	5b5c877da7	Merge remote-tracking branch 'origin/develop' into develop	2019-05-28 14:20:53 +08:00
Marvin Zhang	7ed9a52f27	added generate_urls function	2019-05-28 13:32:00 +08:00
Marvin Zhang	26e7a49a59	added generate_urls function	2019-05-28 13:27:25 +08:00
Marvin Zhang	78eacaa8dc	updated requirements.txt	2019-05-28 11:31:32 +08:00
Marvin Zhang	68a2a9fa4e	Merge remote-tracking branch 'origin/develop' into develop ... # Conflicts: # frontend/src/views/spider/SpiderList.vue	2019-05-26 19:19:43 +08:00
Marvin Zhang	dfcaf22f55	updated configurable spider	2019-05-26 19:17:02 +08:00
Marvin Zhang	83f4be648c	updated configurable spider	2019-05-26 19:16:46 +08:00
Marvin Zhang	d3f776802e	updated configurable spider	2019-05-26 17:10:04 +08:00
Marvin Zhang	96a9c22077	added configurable spider: add/edit fields, preview results	2019-05-25 20:18:27 +08:00
Marvin Zhang	5477099f15	prepared for configurable spiders	2019-05-24 17:28:25 +08:00
Marvin Zhang	fe45a9cedc	fixed add schedules error issue	2019-05-23 17:13:20 +08:00
Marvin Zhang	967981d3e3	updated sites	2019-05-22 22:33:28 +08:00
Marvin Zhang	84289bca1a	cleanup requirements.txt	2019-05-22 13:17:15 +08:00
Marvin Zhang	0a845b4f19	cleanup requirements.txt	2019-05-22 13:16:56 +08:00
Marvin Zhang	2a5b5c038c	cleanup requirements.txt	2019-05-22 13:16:45 +08:00
Marvin Zhang	ade4f42365	refactor code	2019-05-21 12:28:33 +08:00
Marvin Zhang	b7b89cf72d	added jd spider	2019-05-10 21:25:17 +08:00
Marvin Zhang	d530d19b51	link site to spider	2019-05-10 13:26:58 +08:00
Marvin Zhang	4bd93db193	added site list	2019-05-09 22:14:37 +08:00
Marvin Zhang	cac84161f0	fixed pymongo connection issue	2019-05-09 19:44:47 +08:00
Marvin Zhang	7daf8d4c2a	fixed pymongo connection issue	2019-05-09 19:43:02 +08:00
Marvin Zhang	8608664b9d	fixed analytics issue	2019-05-08 12:35:13 +08:00
Marvin Zhang	0cf349c85b	updated stats for spider	2019-04-28 19:38:17 +08:00
Marvin Zhang	be9aed5cb7	updated stats for spider	2019-04-28 19:37:48 +08:00
Marvin Zhang	ae01b4f9e2	updated stats for spider	2019-04-28 19:32:23 +08:00
Marvin Zhang	e06f5a343c	updated stats for spider	2019-04-28 19:23:21 +08:00
Marvin Zhang	5705a7e4ac	added stats for spider	2019-04-28 13:18:03 +08:00
Marvin Zhang	a9f59dc110	added analytics for spider	2019-04-28 13:17:40 +08:00
Marvin Zhang	7b61a20324	added virtualenv to python executable	2019-04-26 12:36:31 +08:00
Marvin Zhang	677d6e36a9	added stats for spider	2019-04-23 20:25:15 +08:00
Marvin Zhang	4cd5407e98	fix issue #12	2019-04-23 19:40:33 +08:00
Marvin Zhang	d495912f5c	fix issue #12	2019-04-23 19:33:50 +08:00