Commit Graph

31 Commits

Author SHA1 Message Date
Marvin Zhang
a46b8e2270 updated ScheduleList 2019-04-17 13:23:28 +08:00
Marvin Zhang
686a900917 updated scheduler 2019-04-17 13:08:06 +08:00
Marvin Zhang
aa9dcef9b6 added schedule functionality 2019-04-17 12:53:19 +08:00
Marvin Zhang
ffaccd67fd added lianjia example 2019-04-16 20:19:22 +08:00
Marvin Zhang
d48fee0d03 enforce deploy before running a spider 2019-04-15 19:50:25 +08:00
Marvin Zhang
f004c1a70a added environment variables for spider page 2019-04-10 22:16:25 +08:00
Marvin Zhang
563ecea96f updated README.md
code cleanup
2019-04-03 19:58:21 +08:00
cxa
61f7ff6a89 fix bug 2019-04-03 16:32:35 +08:00
Marvin Zhang
d44e5d2518 updated Multi Language for a few pages 2019-03-27 12:35:22 +08:00
Marvin Zhang
3af510a417 updated Multi Language for a few pages 2019-03-26 19:33:03 +08:00
Marvin Zhang
9a7ade8e6e added Multi Language support 2019-03-23 23:48:08 +08:00
Marvin Zhang
d68b4fb554 removed a task 2019-03-16 21:30:27 +08:00
Marvin Zhang
b27a36befc changed the way how task is saved to database 2019-03-16 21:29:30 +08:00
Marvin Zhang
6ed8a449ce changed the way how task is saved to database 2019-03-13 21:33:47 +08:00
Marvin Zhang
e7ec1259a8 updated README 2019-03-13 19:27:14 +08:00
Marvin Zhang
9f38119a9d fixed dev/production env issue 2019-03-13 12:45:13 +08:00
Marvin Zhang
8214d8ff50 fixed dev/production env issue 2019-03-13 12:42:13 +08:00
Marvin Zhang
17c605ebd4 added pagination for tasks results 2019-03-12 21:20:22 +08:00
Marvin Zhang
4081899e71 added pagination for tasks 2019-03-12 21:01:14 +08:00
Marvin Zhang
849a812e23 added pagination for tasks 2019-03-12 21:00:35 +08:00
Marvin Zhang
508712ba07 fixed inconsistency of timestamp issue 2019-03-12 20:28:50 +08:00
Marvin Zhang
c532d0614d fixed deploy issue 2019-03-12 13:01:18 +08:00
Marvin Zhang
4d4228d7ce updated error message 2019-03-09 16:27:23 +08:00
Marvin Zhang
8d4ccddd8c added stop task 2019-03-09 16:18:39 +08:00
Marvin Zhang
189d7da299 updated cron tasks: fixed task run duplication issue 2019-03-09 15:35:48 +08:00
Marvin Zhang
cc4a0eefc3 added cron tasks for spiders 2019-03-09 14:05:14 +08:00
Marvin Zhang
1fb09e4d1f support multi-node log view 2019-03-06 15:43:14 +08:00
Marvin Zhang
a31893b48a added Results 2019-03-06 13:14:26 +08:00
Marvin Zhang
de3247269c updated methodologies of deployment and running spider 2019-03-05 13:22:23 +08:00
Marvin Zhang
95cf526013 added github import 2019-03-04 12:07:14 +08:00
Marvin Zhang
cc59e1cfce added setup.py 2019-03-03 10:48:04 +08:00