Commit Graph

160 Commits

Author SHA1 Message Date
Marvin Zhang
ae9535583e updated version 2019-05-10 21:25:51 +08:00
Marvin Zhang
b7b89cf72d added jd spider 2019-05-10 21:25:17 +08:00
Marvin Zhang
133f1197fd link site to spider 2019-05-10 13:27:13 +08:00
Marvin Zhang
d530d19b51 link site to spider 2019-05-10 13:26:58 +08:00
Marvin Zhang
3fb42a154c added chinaz spider 2019-05-10 12:39:10 +08:00
Marvin Zhang
6a12dfe7b7 added site list 2019-05-09 22:28:12 +08:00
Marvin Zhang
42e4ba9093 added site list 2019-05-09 22:15:58 +08:00
Marvin Zhang
4bd93db193 added site list 2019-05-09 22:14:37 +08:00
Marvin Zhang
ba907fe83b added chinaz spider 2019-05-09 20:52:59 +08:00
Marvin Zhang
7822d17058 fixed translation typo 2019-05-09 19:46:49 +08:00
Marvin Zhang
cac84161f0 fixed pymongo connection issue 2019-05-09 19:44:47 +08:00
Marvin Zhang
7daf8d4c2a fixed pymongo connection issue 2019-05-09 19:43:02 +08:00
Marvin Zhang
8608664b9d fixed analytics issue 2019-05-08 12:35:13 +08:00
Marvin Zhang
f6c09c5ab1 updated analytics for spider 2019-04-28 21:25:32 +08:00
Marvin Zhang
d26bcf265b updated analytics for spider 2019-04-28 21:16:31 +08:00
Marvin Zhang
566a0ff1cd updated analytics for spider 2019-04-28 19:52:10 +08:00
Marvin Zhang
05332beb2c updated analytics for spider 2019-04-28 19:41:44 +08:00
Marvin Zhang
0cf349c85b updated stats for spider 2019-04-28 19:38:17 +08:00
Marvin Zhang
be9aed5cb7 updated stats for spider 2019-04-28 19:37:48 +08:00
Marvin Zhang
ae01b4f9e2 updated stats for spider 2019-04-28 19:32:23 +08:00
Marvin Zhang
cac76245ad updated analytics for spider 2019-04-28 19:32:18 +08:00
Marvin Zhang
1410ec2b6d updated analytics for spider 2019-04-28 19:24:03 +08:00
Marvin Zhang
e06f5a343c updated stats for spider 2019-04-28 19:23:21 +08:00
Marvin Zhang
5705a7e4ac added stats for spider 2019-04-28 13:18:03 +08:00
Marvin Zhang
a9f59dc110 added analytics for spider 2019-04-28 13:17:40 +08:00
Marvin Zhang
7b61a20324 added virtualenv to python executable 2019-04-26 12:36:31 +08:00
Marvin Zhang
71c5c6342d request task list every 5 seconds 2019-04-23 20:36:31 +08:00
Marvin Zhang
677d6e36a9 added stats for spider 2019-04-23 20:25:15 +08:00
Marvin Zhang
c342d81fe1 request task list every 5 seconds 2019-04-23 19:52:06 +08:00
Marvin Zhang
4cd5407e98 fix issue #12 2019-04-23 19:40:33 +08:00
Marvin Zhang
d495912f5c fix issue #12 2019-04-23 19:33:50 +08:00
Marvin Zhang
22fd9ba848 added filter for TaskList 2019-04-22 21:26:58 +08:00
Marvin Zhang
8f5a3fa133 added results stats for tasks 2019-04-22 21:06:08 +08:00
Marvin Zhang
64a5081604 Merge remote-tracking branch 'origin/develop' into develop 2019-04-20 20:05:00 +08:00
Marvin Zhang
3407e4e8df added params for spider schedules 2019-04-20 20:04:09 +08:00
Marvin Zhang
c90a7f0ccd Merge pull request #22 from casperwnb/develop
Develop
2019-04-19 13:48:18 +08:00
casperwnb
2965513df7 Merge remote-tracking branch 'upstream/master' into develop 2019-04-19 12:34:48 +08:00
casperwnb
bf3ffb49b9 Merge remote-tracking branch 'upstream/develop' into develop 2019-04-19 12:34:35 +08:00
casperwnb
a367c1765c Merge branch 'develop' of https://github.com/casperwnb/crawlab into develop 2019-04-19 12:11:25 +08:00
casperwnb
d37be4f4ce modify config setting 2019-04-19 11:35:14 +08:00
Marvin Zhang
6ceb00aedc updated scheduler 2019-04-17 22:07:48 +08:00
Marvin Zhang
aa6f414e42 added filter for TaskList 2019-04-17 21:50:30 +08:00
Marvin Zhang
6b30ad22ab updated cron schedule logic 2019-04-17 21:22:02 +08:00
Marvin Zhang
dda6a77651 Merge pull request #20 from tikazyq/develop
Develop
2019-04-17 13:25:47 +08:00
Marvin Zhang
c48bb96b2f updated ScheduleList 2019-04-17 13:25:14 +08:00
Marvin Zhang
a46b8e2270 updated ScheduleList 2019-04-17 13:23:28 +08:00
Marvin Zhang
686a900917 updated scheduler 2019-04-17 13:08:06 +08:00
Marvin Zhang
aa9dcef9b6 added schedule functionality 2019-04-17 12:53:19 +08:00
Marvin Zhang
ffaccd67fd added lianjia example 2019-04-16 20:19:22 +08:00
Marvin Zhang
0b94bf241d Merge remote-tracking branch 'origin/develop' into develop 2019-04-15 19:50:41 +08:00