Commit Graph

47 Commits

Author SHA1 Message Date
Marvin Zhang
bd7a9e27c7 added file edit 2019-07-24 19:51:52 +08:00
Marvin Zhang
c6bd35bd02 updated frontend to adapt changes of golang version 2019-07-22 12:32:36 +08:00
Marvin Zhang
67c299e5d9 adapt changes to golang api 2019-07-21 16:48:58 +08:00
Marvin Zhang
d4bcc3c3fc updated sinastock_spider: time zone adjustment 2019-07-07 09:34:02 +08:00
Marvin Zhang
2c05c720fc updated sinastock_spider 2019-07-07 09:17:15 +08:00
Marvin Zhang
12e99921ae updated sinastock_spider 2019-07-07 09:03:02 +08:00
Marvin Zhang
541f17aa61 updated sinastock_spider 2019-07-04 18:21:08 +08:00
Marvin Zhang
f06e95537e added sinastock spider 2019-07-02 21:01:37 +08:00
Marvin Zhang
d66f4d4b39 fixed https://github.com/tikazyq/crawlab/issues/74 2019-06-29 11:52:41 +08:00
Marvin Zhang
9f333f025c updated xueqiu spider 2019-06-23 21:08:47 +08:00
Marvin Zhang
d92abb50d2 updated xueqiu spider 2019-06-23 20:57:22 +08:00
Marvin Zhang
3a86b1b2f7 updated xueqiu spider 2019-06-23 13:58:04 +08:00
Marvin Zhang
29cea71ab8 added xueqiu spider 2019-06-23 11:42:43 +08:00
Marvin Zhang
fc15fa42ac added xueqiu spider 2019-06-23 11:42:33 +08:00
Marvin Zhang
016363c340 updated Jenkinsfile 2019-06-22 15:19:40 +08:00
Marvin Zhang
823c7f6b53 added generate_urls function 2019-05-28 13:27:25 +08:00
Marvin Zhang
9ba5623d62 updated chinaz_spider 2019-05-22 23:10:33 +08:00
Marvin Zhang
8e96ad8cb6 updated sites 2019-05-22 22:33:28 +08:00
Marvin Zhang
9b23b1a4c6 updated sites_inspector 2019-05-22 20:08:38 +08:00
Marvin Zhang
d545dc2697 cleanup requirements.txt 2019-05-22 13:16:45 +08:00
Marvin Zhang
1f015730c1 refactor code 2019-05-21 12:28:33 +08:00
Marvin Zhang
73e3bc2dec added jd spider 2019-05-10 21:25:17 +08:00
Marvin Zhang
1cd2fd47f3 link site to spider 2019-05-10 13:26:58 +08:00
Marvin Zhang
69e2e2f3c5 added chinaz spider 2019-05-10 12:39:10 +08:00
Marvin Zhang
e3d4796d8a added chinaz spider 2019-05-09 20:52:59 +08:00
Marvin Zhang
b169f09e12 added lianjia example 2019-04-16 20:19:22 +08:00
Marvin Zhang
6712b3a5f1 added environment variables for spider page 2019-04-10 22:16:25 +08:00
Marvin Zhang
7ce74e06d7 updated README.md
code cleanup
2019-04-03 19:58:21 +08:00
cxa
054f63d93f 修改文件的配置地址为127.0.0.1系列 2019-04-03 17:08:26 +08:00
cxa
df43a7fc96 fix bug 2019-04-03 16:32:35 +08:00
Marvin Zhang
640c6d2137 added article_spider.js 2019-03-20 20:58:27 +08:00
Marvin Zhang
9aeff8181c added spiders 2019-03-15 20:22:09 +08:00
Marvin Zhang
53a80046d1 changed the way how task is saved to database 2019-03-13 21:33:47 +08:00
Marvin Zhang
ff631e1095 updated README 2019-03-13 19:27:14 +08:00
Marvin Zhang
5b190e5b2b modified task status update logic 2019-03-12 13:10:24 +08:00
Marvin Zhang
0dc5c64bc1 added spider for segmentfault 2019-03-11 13:15:00 +08:00
Marvin Zhang
647fac1efe added cron tasks for spiders 2019-03-09 14:05:14 +08:00
Marvin Zhang
af21ab4841 added Results 2019-03-06 13:14:26 +08:00
Marvin Zhang
68e0b98d8a updated README.md 2019-03-06 10:46:41 +08:00
Marvin Zhang
a473aef621 restructured code 2019-03-06 10:11:07 +08:00
Marvin Zhang
318e5876a6 fixed sorting issue 2019-02-25 19:32:43 +08:00
Marvin Zhang
278d6e72f5 added TaskOverview 2019-02-23 18:39:22 +08:00
Marvin Zhang
913c0644c9 updated node/spider overviews 2019-02-21 14:08:48 +08:00
Marvin Zhang
5eb69a4b0d overview pages updated 2019-02-20 21:24:28 +08:00
Marvin Zhang
a4a0fdd67b added tasks 2019-02-18 21:16:40 +08:00
Marvin Zhang
714ccd18aa update SpiderDetail 2019-02-17 11:14:22 +08:00
Yeqing Zhang
bbeb5ca5b5 added deploys 2019-02-13 20:53:15 +08:00