59 Commits

Author	SHA1	Message	Date
Marvin Zhang	0cf349c85b	updated stats for spider	2019-04-28 19:38:17 +08:00
Marvin Zhang	be9aed5cb7	updated stats for spider	2019-04-28 19:37:48 +08:00
Marvin Zhang	ae01b4f9e2	updated stats for spider	2019-04-28 19:32:23 +08:00
Marvin Zhang	e06f5a343c	updated stats for spider	2019-04-28 19:23:21 +08:00
Marvin Zhang	5705a7e4ac	added stats for spider	2019-04-28 13:18:03 +08:00
Marvin Zhang	a9f59dc110	added analytics for spider	2019-04-28 13:17:40 +08:00
Marvin Zhang	7b61a20324	added virtualenv to python executable	2019-04-26 12:36:31 +08:00
Marvin Zhang	677d6e36a9	added stats for spider	2019-04-23 20:25:15 +08:00
Marvin Zhang	4cd5407e98	fix issue #12	2019-04-23 19:40:33 +08:00
Marvin Zhang	d495912f5c	fix issue #12	2019-04-23 19:33:50 +08:00
Marvin Zhang	8f5a3fa133	added results stats for tasks	2019-04-22 21:06:08 +08:00
Marvin Zhang	64a5081604	Merge remote-tracking branch 'origin/develop' into develop	2019-04-20 20:05:00 +08:00
Marvin Zhang	3407e4e8df	added params for spider schedules	2019-04-20 20:04:09 +08:00
casperwnb	bf3ffb49b9	Merge remote-tracking branch 'upstream/develop' into develop	2019-04-19 12:34:35 +08:00
casperwnb	a367c1765c	Merge branch 'develop' of https://github.com/casperwnb/crawlab into develop	2019-04-19 12:11:25 +08:00
casperwnb	d37be4f4ce	modify config setting	2019-04-19 11:35:14 +08:00
Marvin Zhang	6ceb00aedc	updated scheduler	2019-04-17 22:07:48 +08:00
Marvin Zhang	6b30ad22ab	updated cron schedule logic	2019-04-17 21:22:02 +08:00
Marvin Zhang	686a900917	updated scheduler	2019-04-17 13:08:06 +08:00
Marvin Zhang	aa9dcef9b6	added schedule functionality	2019-04-17 12:53:19 +08:00
Marvin Zhang	ffaccd67fd	added lianjia example	2019-04-16 20:19:22 +08:00
Marvin Zhang	d48fee0d03	enforce deploy before running a spider	2019-04-15 19:50:25 +08:00
Marvin Zhang	f004c1a70a	added environment variables for spider page	2019-04-10 22:16:25 +08:00
Marvin Zhang	312df546c0	return to flask_restful	2019-04-08 19:33:34 +08:00
Marvin Zhang	f88a2cf45b	added swagger.yaml	2019-04-08 19:31:41 +08:00
Marvin Zhang	3288ae39d1	updated API docs	2019-04-07 19:07:00 +08:00
Marvin Zhang	e9778822ed	updated some parts of API docs	2019-04-07 16:39:55 +08:00
Marvin Zhang	e6e7ba52c7	pre-add flask_restplus	2019-04-03 20:39:19 +08:00
Marvin Zhang	563ecea96f	updated README.md ... code cleanup	2019-04-03 19:58:21 +08:00
cxa	08f22d08af	change print to logger	2019-04-03 18:02:14 +08:00
cxa	61f7ff6a89	fix bug	2019-04-03 16:32:35 +08:00
Marvin Zhang	1c6d9c9df1	fixed Issue #3	2019-03-23 21:12:14 +08:00
Marvin Zhang	f624779da5	fixed Issue #3	2019-03-23 21:03:27 +08:00
Marvin Zhang	d94c3adc8a	switch off celery logging info	2019-03-23 20:53:42 +08:00
Marvin Zhang	cf17909482	added article_spider.js	2019-03-20 20:58:27 +08:00
Marvin Zhang	bbdec7c61e	updated celery logging info	2019-03-19 13:06:35 +08:00
Marvin Zhang	bc1a2b2db1	updated celery logging info	2019-03-19 13:04:53 +08:00
Marvin Zhang	d0651f80ed	updated celery logging info	2019-03-19 12:57:36 +08:00
Marvin Zhang	c68bd0ceb1	updated import logic	2019-03-18 20:22:59 +08:00
Marvin Zhang	826fe50f1e	changed the task status logic	2019-03-16 21:28:09 +08:00
Marvin Zhang	c342ca715f	git webhook test	2019-03-16 19:36:04 +08:00
Marvin Zhang	12a18cad2d	git webhook test	2019-03-16 19:30:37 +08:00
Marvin Zhang	ca80fd8337	git webhook test	2019-03-16 19:27:38 +08:00
Marvin Zhang	6ed8a449ce	changed the way how task is saved to database	2019-03-13 21:33:47 +08:00
Marvin Zhang	0d77850e3d	modified task status update logic	2019-03-13 12:55:19 +08:00
Marvin Zhang	17c605ebd4	added pagination for tasks results	2019-03-12 21:20:22 +08:00
Marvin Zhang	849a812e23	added pagination for tasks	2019-03-12 21:00:35 +08:00
Marvin Zhang	508712ba07	fixed inconsistency of timestamp issue	2019-03-12 20:28:50 +08:00
Marvin Zhang	9180e00d94	modified task status update logic	2019-03-12 13:10:24 +08:00
Marvin Zhang	c532d0614d	fixed deploy issue	2019-03-12 13:01:18 +08:00