Commit Graph

54 Commits

Author SHA1 Message Date
Marvin Zhang
bc4a04bc6c updated version 2019-05-10 21:25:51 +08:00
Marvin Zhang
73e3bc2dec added jd spider 2019-05-10 21:25:17 +08:00
Marvin Zhang
433b945eeb link site to spider 2019-05-10 13:27:13 +08:00
Marvin Zhang
93f9612b9b added site list 2019-05-09 22:28:12 +08:00
Marvin Zhang
e822c65eb2 added site list 2019-05-09 22:15:58 +08:00
Marvin Zhang
0ad0303285 added site list 2019-05-09 22:14:37 +08:00
Marvin Zhang
34871213d5 fixed translation typo 2019-05-09 19:46:49 +08:00
Marvin Zhang
c96dd102d9 updated analytics for spider 2019-04-28 21:25:32 +08:00
Marvin Zhang
21f7864c68 updated analytics for spider 2019-04-28 21:16:31 +08:00
Marvin Zhang
9bd819c384 updated analytics for spider 2019-04-28 19:52:10 +08:00
Marvin Zhang
60d658de5f updated analytics for spider 2019-04-28 19:41:44 +08:00
Marvin Zhang
efc32886ae updated analytics for spider 2019-04-28 19:32:18 +08:00
Marvin Zhang
70d392ef62 updated analytics for spider 2019-04-28 19:24:03 +08:00
Marvin Zhang
a41415a041 added analytics for spider 2019-04-28 13:17:40 +08:00
Marvin Zhang
ae29708d99 request task list every 5 seconds 2019-04-23 20:36:31 +08:00
Marvin Zhang
b7ed4ad442 added stats for spider 2019-04-23 20:25:15 +08:00
Marvin Zhang
db0f58f9b9 request task list every 5 seconds 2019-04-23 19:52:06 +08:00
Marvin Zhang
4dff16e9ec added filter for TaskList 2019-04-22 21:26:58 +08:00
Marvin Zhang
9a00be811e added params for spider schedules 2019-04-20 20:04:09 +08:00
Marvin Zhang
daeaa05d85 added filter for TaskList 2019-04-17 21:50:30 +08:00
Marvin Zhang
20c721a20e updated ScheduleList 2019-04-17 13:25:14 +08:00
Marvin Zhang
7a41c68982 updated ScheduleList 2019-04-17 13:23:28 +08:00
Marvin Zhang
747dc470bb updated scheduler 2019-04-17 13:08:06 +08:00
Marvin Zhang
8bad2c49b1 added schedule functionality 2019-04-17 12:53:19 +08:00
Marvin Zhang
b169f09e12 added lianjia example 2019-04-16 20:19:22 +08:00
Marvin Zhang
63ff2d1894 enforce deploy before running a spider 2019-04-15 19:50:25 +08:00
Marvin Zhang
6712b3a5f1 added environment variables for spider page 2019-04-10 22:16:25 +08:00
Marvin Zhang
7ce74e06d7 updated README.md
code cleanup
2019-04-03 19:58:21 +08:00
cxa
df43a7fc96 fix bug 2019-04-03 16:32:35 +08:00
Marvin Zhang
063703319c updated Multi Language for a few pages 2019-03-27 12:35:22 +08:00
Marvin Zhang
1efc5199f9 updated Multi Language for a few pages 2019-03-26 19:33:03 +08:00
Marvin Zhang
d6cd8ff8f7 added Multi Language support 2019-03-23 23:48:08 +08:00
Marvin Zhang
c6174df927 removed a task 2019-03-16 21:30:27 +08:00
Marvin Zhang
e526b4215b changed the way how task is saved to database 2019-03-16 21:29:30 +08:00
Marvin Zhang
53a80046d1 changed the way how task is saved to database 2019-03-13 21:33:47 +08:00
Marvin Zhang
ff631e1095 updated README 2019-03-13 19:27:14 +08:00
Marvin Zhang
5e8ee66f70 fixed dev/production env issue 2019-03-13 12:45:13 +08:00
Marvin Zhang
bbd52b3e3b fixed dev/production env issue 2019-03-13 12:42:13 +08:00
Marvin Zhang
1ec3074012 added pagination for tasks results 2019-03-12 21:20:22 +08:00
Marvin Zhang
62194a05ed added pagination for tasks 2019-03-12 21:01:14 +08:00
Marvin Zhang
489768d097 added pagination for tasks 2019-03-12 21:00:35 +08:00
Marvin Zhang
ce5e5d8f1d fixed inconsistency of timestamp issue 2019-03-12 20:28:50 +08:00
Marvin Zhang
497576c913 fixed deploy issue 2019-03-12 13:01:18 +08:00
Marvin Zhang
3aba022922 updated error message 2019-03-09 16:27:23 +08:00
Marvin Zhang
0df8d84105 added stop task 2019-03-09 16:18:39 +08:00
Marvin Zhang
768628737c updated cron tasks: fixed task run duplication issue 2019-03-09 15:35:48 +08:00
Marvin Zhang
647fac1efe added cron tasks for spiders 2019-03-09 14:05:14 +08:00
Marvin Zhang
4b076ad6aa updated README.md 2019-03-06 17:14:17 +08:00
Marvin Zhang
9ba2f83e71 updated README.md 2019-03-06 16:40:54 +08:00
Marvin Zhang
a71f9488ec support multi-node log view 2019-03-06 15:43:14 +08:00