Commit Graph

55 Commits

Author SHA1 Message Date
marvzhang
ef5e210868 修复定时任务无法跑可配置爬虫问题 2019-12-09 15:24:16 +08:00
陈景阳
dccc90e451 feature 调度任务可以暂停/运行
feature 任务列表可以批量删除
2019-12-09 10:54:55 +08:00
陈景阳
18f34f1703 Feature 新增定时任务可暂停/运行 2019-12-07 14:03:23 +08:00
marvzhang
c5fad12854 优化 https://github.com/crawlab-team/crawlab/issues/185 2019-12-04 16:33:02 +08:00
marvzhang
98cbccb81e 加入Spiderfile模版 2019-12-03 13:37:41 +08:00
marvzhang
7c19aa1d75 加入可配置爬虫设置页面 2019-12-02 12:43:44 +08:00
marvzhang
5405dba540 加入可配置爬虫阶段设置 2019-11-30 10:58:54 +08:00
marvzhang
83e148b31d 添加可配置爬虫翻译 2019-11-28 22:37:32 +08:00
marvzhang
2ab47e51b3 可配置爬虫前端准备 2019-11-26 13:39:07 +08:00
Marvin Zhang
5013233481 added param to task 2019-09-04 20:13:28 +08:00
yaziming
1c0b86428c 1. Fix Some I18n Warning.
2. Fix Navigation Duplicated Error When Current Route Path is `/login`.
3. Fix  Parent Level Named Route Warning.
4. Change `request` function From Promise Syntax To Await/Async.
2019-09-01 00:36:59 +08:00
陈景阳
ececf8087e 优化代码 2019-08-31 16:00:24 +08:00
Marvin Zhang
f6069a74fa added language switch on login page 2019-08-24 16:56:08 +08:00
Marvin Zhang
eb247f2516 fixed upload bug 2019-07-29 20:30:39 +08:00
Marvin Zhang
087e8e65aa added user management 2019-07-27 00:56:28 +08:00
Marvin Zhang
607ad029dd added user login/signup 2019-07-26 23:02:30 +08:00
Marvin Zhang
ffb8cc5ef9 added login page 2019-07-26 20:04:20 +08:00
Marvin Zhang
946bb7ceba added spider stats 2019-07-26 17:07:24 +08:00
Marvin Zhang
41f5f8b989 added network diagram 2019-07-24 21:03:12 +08:00
Marvin Zhang
2dc51c48fc updated file edit 2019-07-24 19:51:29 +08:00
Marvin Zhang
0bd721795b code clean up 2019-07-23 21:09:08 +08:00
Marvin Zhang
c5620bc2d1 added system info 2019-07-23 20:08:29 +08:00
Marvin Zhang
c6bd35bd02 updated frontend to adapt changes of golang version 2019-07-22 12:32:36 +08:00
Marvin Zhang
67c299e5d9 adapt changes to golang api 2019-07-21 16:48:58 +08:00
Marvin Zhang
2b9cd566eb updated auto field extraction 2019-06-04 23:43:47 +08:00
Marvin Zhang
6c7a06060d updated ConfigList: allow edit field name on preview 2019-06-04 13:09:57 +08:00
Marvin Zhang
c0cec217d7 updated auto field extraction 2019-06-04 07:55:51 +08:00
Marvin Zhang
2a8e33d3c7 download results 2019-05-30 13:07:09 +08:00
Marvin Zhang
2dd0a7cebf added baidu tongji for analytics 2019-05-29 22:22:54 +08:00
Marvin Zhang
f3da64d8b7 code cleanup 2019-05-29 13:10:31 +08:00
Marvin Zhang
e30c1c122a updated configurable spider 2019-05-26 19:16:46 +08:00
Marvin Zhang
5daebcb39b updated configurable spider 2019-05-26 17:10:04 +08:00
Marvin Zhang
15f9b7ef05 added configurable spider: add/edit fields, preview results 2019-05-25 20:18:27 +08:00
Marvin Zhang
04789febc8 prepared for configurable spiders 2019-05-24 17:28:25 +08:00
Marvin Zhang
d3ed3694a6 updated SiteList 2019-05-22 22:39:02 +08:00
Marvin Zhang
c5a3d32579 updated SiteList 2019-05-22 22:33:43 +08:00
Marvin Zhang
841b5d95d9 updated SiteList 2019-05-22 19:24:27 +08:00
Marvin Zhang
97752ba705 添加robots.txt协议解析 2019-05-21 13:34:07 +08:00
Marvin Zhang
73e3bc2dec added jd spider 2019-05-10 21:25:17 +08:00
Marvin Zhang
93f9612b9b added site list 2019-05-09 22:28:12 +08:00
Marvin Zhang
e822c65eb2 added site list 2019-05-09 22:15:58 +08:00
Marvin Zhang
34871213d5 fixed translation typo 2019-05-09 19:46:49 +08:00
Marvin Zhang
9bd819c384 updated analytics for spider 2019-04-28 19:52:10 +08:00
Marvin Zhang
a41415a041 added analytics for spider 2019-04-28 13:17:40 +08:00
Marvin Zhang
b7ed4ad442 added stats for spider 2019-04-23 20:25:15 +08:00
Marvin Zhang
4dff16e9ec added filter for TaskList 2019-04-22 21:26:58 +08:00
Marvin Zhang
9a00be811e added params for spider schedules 2019-04-20 20:04:09 +08:00
Marvin Zhang
b169f09e12 added lianjia example 2019-04-16 20:19:22 +08:00
Marvin Zhang
63ff2d1894 enforce deploy before running a spider 2019-04-15 19:50:25 +08:00
Marvin Zhang
6712b3a5f1 added environment variables for spider page 2019-04-10 22:16:25 +08:00