Commit Graph

47 Commits

Author SHA1 Message Date
Marvin Zhang
eb3c7d9f81 added file edit 2019-07-24 19:51:52 +08:00
Marvin Zhang
520e8fded8 updated frontend to adapt changes of golang version 2019-07-22 12:32:36 +08:00
Marvin Zhang
ece3659155 adapt changes to golang api 2019-07-21 16:48:58 +08:00
Marvin Zhang
1a375c7109 updated sinastock_spider: time zone adjustment 2019-07-07 09:34:02 +08:00
Marvin Zhang
ac26d28777 updated sinastock_spider 2019-07-07 09:17:15 +08:00
Marvin Zhang
1a07d417ed updated sinastock_spider 2019-07-07 09:03:02 +08:00
Marvin Zhang
83e953fbf0 updated sinastock_spider 2019-07-04 18:21:08 +08:00
Marvin Zhang
c7f4122031 added sinastock spider 2019-07-02 21:01:37 +08:00
Marvin Zhang
1de4281ec9 fixed https://github.com/tikazyq/crawlab/issues/74 2019-06-29 11:52:41 +08:00
Marvin Zhang
17059a814d updated xueqiu spider 2019-06-23 21:08:47 +08:00
Marvin Zhang
f0d4a6f36c updated xueqiu spider 2019-06-23 20:57:22 +08:00
Marvin Zhang
6b2974ac54 updated xueqiu spider 2019-06-23 13:58:04 +08:00
Marvin Zhang
38d4e21357 added xueqiu spider 2019-06-23 11:42:43 +08:00
Marvin Zhang
37a143d889 added xueqiu spider 2019-06-23 11:42:33 +08:00
Marvin Zhang
fd430b8b2c updated Jenkinsfile 2019-06-22 15:19:40 +08:00
Marvin Zhang
26e7a49a59 added generate_urls function 2019-05-28 13:27:25 +08:00
Marvin Zhang
8406f06522 updated chinaz_spider 2019-05-22 23:10:33 +08:00
Marvin Zhang
967981d3e3 updated sites 2019-05-22 22:33:28 +08:00
Marvin Zhang
2e01c6a08f updated sites_inspector 2019-05-22 20:08:38 +08:00
Marvin Zhang
2a5b5c038c cleanup requirements.txt 2019-05-22 13:16:45 +08:00
Marvin Zhang
ade4f42365 refactor code 2019-05-21 12:28:33 +08:00
Marvin Zhang
b7b89cf72d added jd spider 2019-05-10 21:25:17 +08:00
Marvin Zhang
d530d19b51 link site to spider 2019-05-10 13:26:58 +08:00
Marvin Zhang
3fb42a154c added chinaz spider 2019-05-10 12:39:10 +08:00
Marvin Zhang
ba907fe83b added chinaz spider 2019-05-09 20:52:59 +08:00
Marvin Zhang
ffaccd67fd added lianjia example 2019-04-16 20:19:22 +08:00
Marvin Zhang
f004c1a70a added environment variables for spider page 2019-04-10 22:16:25 +08:00
Marvin Zhang
563ecea96f updated README.md
code cleanup
2019-04-03 19:58:21 +08:00
cxa
d17dc679de 修改文件的配置地址为127.0.0.1系列 2019-04-03 17:08:26 +08:00
cxa
61f7ff6a89 fix bug 2019-04-03 16:32:35 +08:00
Marvin Zhang
cf17909482 added article_spider.js 2019-03-20 20:58:27 +08:00
Marvin Zhang
931548d5a5 added spiders 2019-03-15 20:22:09 +08:00
Marvin Zhang
6ed8a449ce changed the way how task is saved to database 2019-03-13 21:33:47 +08:00
Marvin Zhang
e7ec1259a8 updated README 2019-03-13 19:27:14 +08:00
Marvin Zhang
9180e00d94 modified task status update logic 2019-03-12 13:10:24 +08:00
Marvin Zhang
b7bf01e5f2 added spider for segmentfault 2019-03-11 13:15:00 +08:00
Marvin Zhang
cc4a0eefc3 added cron tasks for spiders 2019-03-09 14:05:14 +08:00
Marvin Zhang
a31893b48a added Results 2019-03-06 13:14:26 +08:00
Marvin Zhang
72e7a0202b updated README.md 2019-03-06 10:46:41 +08:00
Marvin Zhang
fc4c98eccf restructured code 2019-03-06 10:11:07 +08:00
Marvin Zhang
264339e394 fixed sorting issue 2019-02-25 19:32:43 +08:00
Marvin Zhang
e27d606230 added TaskOverview 2019-02-23 18:39:22 +08:00
Marvin Zhang
0480984cdb updated node/spider overviews 2019-02-21 14:08:48 +08:00
Marvin Zhang
7959fd03ad overview pages updated 2019-02-20 21:24:28 +08:00
Marvin Zhang
140a43d1b3 added tasks 2019-02-18 21:16:40 +08:00
Marvin Zhang
d79a436960 update SpiderDetail 2019-02-17 11:14:22 +08:00
Yeqing Zhang
39b687f0d1 added deploys 2019-02-13 20:53:15 +08:00