Commit Graph

60 Commits

Author SHA1 Message Date
marvzhang
97ca3b74b8 修复爬虫被覆盖的问题 2019-12-04 14:54:49 +08:00
marvzhang
589190d674 加入Spiderfile模版 2019-12-03 13:37:41 +08:00
marvzhang
8eafbf480c 完成可配置爬虫设置部分 2019-12-02 13:29:00 +08:00
marvzhang
76a47df2c5 修复bug 2019-11-29 13:00:19 +08:00
marvzhang
07cc759ab1 调整顺序 2019-11-28 22:23:12 +08:00
marvzhang
7dcc35b8c2 加入添加可配置爬虫 2019-11-28 22:19:49 +08:00
marvzhang
ba4f5fd20c 优化可配置爬虫前端界面 2019-11-28 21:36:17 +08:00
marvzhang
550d98326e fixed 配置下划线不显示的问题 2019-11-28 12:54:56 +08:00
marvzhang
24880175e2 fixed: 点击列表按钮导航进入详情页面问题 2019-11-28 12:39:07 +08:00
marvzhang
2e569c44c4 加入前端可配置编辑器 2019-11-27 12:18:51 +08:00
marvzhang
eb19a1e6dd 可配置爬虫前端准备 2019-11-26 13:39:07 +08:00
陈景阳
417b98074c fix 无法选择节点的问题 2019-10-16 15:32:15 +08:00
陈景阳
4881b81544 fix 爬虫列表按钮无法点击的问题 2019-10-10 17:59:15 +08:00
陈景阳
dfea6d330c fix 非自定义爬虫看不到文件的情况 2019-10-08 14:46:03 +08:00
陈景阳
8294e7cb4b 完成爬虫的分类 2019-09-30 16:35:36 +08:00
陈景阳
a12f4ec3ac 添加爬虫列下 2019-09-30 14:44:10 +08:00
陈景阳
277e52ea61 爬虫列表 2019-09-26 20:52:45 +08:00
陈景阳
e5d33b8982 fix 删除spider没有删除task 2019-09-05 20:07:08 +08:00
Marvin Zhang
eb1a80ec2d added param to task 2019-09-04 20:13:28 +08:00
陈景阳
cce5bd71e8 fix 爬虫列表在小屏幕下错位的问题 2019-09-02 09:40:24 +08:00
陈景阳
7a901ff257 添加备注
添加上次运行状态
2019-08-31 16:09:41 +08:00
陈景阳
34cf672c93 优化代码 2019-08-31 16:00:24 +08:00
陈景阳
3bc3eab776 前端UI优化 2019-08-24 14:14:08 +08:00
陈景阳
05dbbc535e 优化一点前端的UI 2019-08-23 20:39:14 +08:00
Marvin Zhang
5c189485a2 updated stats 2019-08-05 20:06:17 +08:00
Marvin Zhang
5bc7085edb enhanced interaction for SpiderList 2019-08-05 20:01:47 +08:00
Marvin Zhang
fc0c8209f7 fixed upload bug 2019-07-29 20:30:39 +08:00
Marvin Zhang
9a2111f713 updated Dockerfile 2019-07-29 12:21:19 +08:00
Marvin Zhang
253c643e8e added spider stats 2019-07-26 17:07:24 +08:00
Marvin Zhang
b01d265060 added file management 2019-07-24 13:37:03 +08:00
Marvin Zhang
f6ba3b04c8 code clean up 2019-07-23 21:09:08 +08:00
Marvin Zhang
520e8fded8 updated frontend to adapt changes of golang version 2019-07-22 12:32:36 +08:00
Marvin Zhang
ece3659155 adapt changes to golang api 2019-07-21 16:48:58 +08:00
Marvin Zhang
0363d5636e added upload functionality 2019-06-04 21:15:54 +08:00
Marvin Zhang
dd08a8b0dc added upload functionality 2019-06-04 20:45:56 +08:00
Marvin Zhang
44a941c72a fixed send user stats issue 2019-06-04 20:26:33 +08:00
Marvin Zhang
a3a5916d8f added pagination for SpiderList 2019-06-04 13:40:37 +08:00
Marvin Zhang
5dc38372e7 updated auto field extraction 2019-06-04 07:55:51 +08:00
Marvin Zhang
392b2cc0b1 burying points for analytics 2019-05-30 21:14:30 +08:00
Marvin Zhang
68a2a9fa4e Merge remote-tracking branch 'origin/develop' into develop
# Conflicts:
#	frontend/src/views/spider/SpiderList.vue
2019-05-26 19:19:43 +08:00
Marvin Zhang
d3f776802e updated configurable spider 2019-05-26 17:10:04 +08:00
Marvin Zhang
5477099f15 prepared for configurable spiders 2019-05-24 17:28:25 +08:00
Marvin Zhang
2fce5efab8 UI adjustment 2019-05-23 17:12:29 +08:00
Marvin Zhang
f63b58906e updated SiteList 2019-05-22 22:33:43 +08:00
Marvin Zhang
c69c8e5f64 updated SiteList 2019-05-22 19:24:27 +08:00
Marvin Zhang
b7b89cf72d added jd spider 2019-05-10 21:25:17 +08:00
Marvin Zhang
a9f59dc110 added analytics for spider 2019-04-28 13:17:40 +08:00
Marvin Zhang
677d6e36a9 added stats for spider 2019-04-23 20:25:15 +08:00
Marvin Zhang
d48fee0d03 enforce deploy before running a spider 2019-04-15 19:50:25 +08:00
Marvin Zhang
f004c1a70a added environment variables for spider page 2019-04-10 22:16:25 +08:00