Commit Graph

207 Commits

Author SHA1 Message Date
Marvin Zhang
925f643cd8 added extracting list fields functionality 2019-05-29 17:51:44 +08:00
Marvin Zhang
2e2b65f691 added automatic extraction of fields functionality 2019-05-29 17:50:34 +08:00
Marvin Zhang
e67e356a4b Merge remote-tracking branch 'origin/develop' into develop 2019-05-29 14:45:30 +08:00
Marvin Zhang
0ebdb3a823 updated env files 2019-05-29 14:44:33 +08:00
Marvin Zhang
41661892cf prepare for list fields extraction 2019-05-29 13:44:29 +08:00
Marvin Zhang
d7c6680ee4 prepare for list fields extraction 2019-05-29 13:43:03 +08:00
Marvin Zhang
e570bcfa13 prepare for list fields extraction 2019-05-29 13:33:05 +08:00
Marvin Zhang
87c81deefb code cleanup 2019-05-29 13:10:31 +08:00
Marvin Zhang
d130b0a04c updated README 2019-05-29 12:40:36 +08:00
Marvin Zhang
aac274a1c2 added payment.jpg 2019-05-29 12:31:12 +08:00
Marvin Zhang
fc4b118174 updated requirements.txt 2019-05-29 12:09:10 +08:00
Marvin Zhang
1f458a96e2 updated requirements.txt 2019-05-29 12:06:24 +08:00
Marvin Zhang
02e6e6117c updated README 2019-05-28 22:59:57 +08:00
Marvin Zhang
01225da400 Merge branch 'develop' of https://github.com/tikazyq/crawlab into develop 2019-05-28 22:39:38 +08:00
Marvin Zhang
a16e6cd42e images cleanup 2019-05-28 22:38:40 +08:00
Marvin Zhang
f710d327b1 allow generate URLs by pattern 2019-05-28 14:59:21 +08:00
Marvin Zhang
dec76bbca9 compatibility issue with win32 2019-05-28 14:22:45 +08:00
Marvin Zhang
5b5c877da7 Merge remote-tracking branch 'origin/develop' into develop 2019-05-28 14:20:53 +08:00
Marvin Zhang
7ed9a52f27 added generate_urls function 2019-05-28 13:32:00 +08:00
Marvin Zhang
26e7a49a59 added generate_urls function 2019-05-28 13:27:25 +08:00
Marvin Zhang
78eacaa8dc updated requirements.txt 2019-05-28 11:31:32 +08:00
Marvin Zhang
68a2a9fa4e Merge remote-tracking branch 'origin/develop' into develop
# Conflicts:
#	frontend/src/views/spider/SpiderList.vue
2019-05-26 19:19:43 +08:00
Marvin Zhang
dfcaf22f55 updated configurable spider 2019-05-26 19:17:02 +08:00
Marvin Zhang
83f4be648c updated configurable spider 2019-05-26 19:16:46 +08:00
Marvin Zhang
d3f776802e updated configurable spider 2019-05-26 17:10:04 +08:00
Marvin Zhang
96a9c22077 added configurable spider: add/edit fields, preview results 2019-05-25 20:18:27 +08:00
Marvin Zhang
5477099f15 prepared for configurable spiders 2019-05-24 17:28:25 +08:00
Marvin Zhang
fe45a9cedc fixed add schedules error issue 2019-05-23 17:13:20 +08:00
Marvin Zhang
2fce5efab8 UI adjustment 2019-05-23 17:12:29 +08:00
Marvin Zhang
8406f06522 updated chinaz_spider 2019-05-22 23:10:33 +08:00
Marvin Zhang
3c1d3a65ea updated SiteList 2019-05-22 22:39:02 +08:00
Marvin Zhang
f63b58906e updated SiteList 2019-05-22 22:33:43 +08:00
Marvin Zhang
967981d3e3 updated sites 2019-05-22 22:33:28 +08:00
Marvin Zhang
2e01c6a08f updated sites_inspector 2019-05-22 20:08:38 +08:00
Marvin Zhang
c69c8e5f64 updated SiteList 2019-05-22 19:24:27 +08:00
Marvin Zhang
84289bca1a cleanup requirements.txt 2019-05-22 13:17:15 +08:00
Marvin Zhang
0a845b4f19 cleanup requirements.txt 2019-05-22 13:16:56 +08:00
Marvin Zhang
2a5b5c038c cleanup requirements.txt 2019-05-22 13:16:45 +08:00
Marvin Zhang
f96339cdcb added i18n for tags-view 2019-05-22 13:02:14 +08:00
Marvin Zhang
9eaa218be1 Merge pull request #29 from woshixiaoqianbi/develop
restore router tag
2019-05-22 13:00:47 +08:00
woshixiaoqianbi
2eb91123b0 restore router tag 2019-05-21 18:00:03 +08:00
Marvin Zhang
d7f8ee13de 添加robots.txt协议解析 2019-05-21 13:34:07 +08:00
Marvin Zhang
ce338e9abf Merge remote-tracking branch 'origin/develop' into develop 2019-05-21 12:28:59 +08:00
Marvin Zhang
ade4f42365 refactor code 2019-05-21 12:28:33 +08:00
Marvin Zhang
5089db25c6 Update README-zh.md 2019-05-21 10:11:17 +08:00
Marvin Zhang
42e27d8003 Update README.md 2019-05-21 10:08:55 +08:00
Marvin Zhang
5cffcd7e1b Create LICENSE 2019-05-17 09:35:40 +08:00
Marvin Zhang
ae9535583e updated version 2019-05-10 21:25:51 +08:00
Marvin Zhang
b7b89cf72d added jd spider 2019-05-10 21:25:17 +08:00
Marvin Zhang
133f1197fd link site to spider 2019-05-10 13:27:13 +08:00