Commit Graph

74 Commits

Author SHA1 Message Date
marvzhang
5811242af9 更新依赖安装逻辑 2019-12-31 12:02:47 +08:00
marvzhang
3e2d762cbd fixed https://github.com/crawlab-team/crawlab/issues/341 2019-12-26 13:04:49 +08:00
marvzhang
971c80239f 尝试加入重命名 2019-12-25 21:07:56 +08:00
marvzhang
7f771a2103 添加文件管理功能 2019-12-25 20:49:27 +08:00
marvzhang
7d5b313a0b 优化爬虫添加逻辑 2019-12-25 19:46:35 +08:00
marvzhang
c5b0011dab 加入添加用户功能 2019-12-20 13:10:46 +08:00
marvzhang
ed7f933aee fixed https://github.com/crawlab-team/crawlab/issues/346 2019-12-20 12:45:37 +08:00
marvzhang
26227dd0dc 修复定时任务不一致问题 2019-12-12 13:13:42 +08:00
陈景阳
f9f04093d9 完成批量删除Task任务列表 2019-12-08 10:58:02 +08:00
陈景阳
18f34f1703 Feature 新增定时任务可暂停/运行 2019-12-07 14:03:23 +08:00
陈景阳
d5cfb04560 添加注释 2019-12-07 10:58:09 +08:00
marvzhang
c5fad12854 优化 https://github.com/crawlab-team/crawlab/issues/185 2019-12-04 16:33:02 +08:00
marvzhang
98cbccb81e 加入Spiderfile模版 2019-12-03 13:37:41 +08:00
marvzhang
c3bc20127d 更新可配置爬虫 2019-12-02 22:35:45 +08:00
marvzhang
eb7d8b8fa3 完成可配置爬虫设置部分 2019-12-02 13:29:00 +08:00
marvzhang
d7cbaac94f 修复bug 2019-11-29 13:00:33 +08:00
marvzhang
5785e3d890 添加可配置爬虫翻译 2019-11-28 22:38:49 +08:00
marvzhang
ee0ad4cede 加入添加可配置爬虫 2019-11-28 22:19:49 +08:00
marvzhang
d65e37517e 优化可配置爬虫前端界面 2019-11-28 21:36:17 +08:00
陈景阳
bdeaa587f9 爬虫列表 2019-09-26 20:52:45 +08:00
陈景阳
82999225de fix 无法获取task的错误 2019-09-25 15:11:27 +08:00
Marvin Zhang
5013233481 added param to task 2019-09-04 20:13:28 +08:00
陈景阳
f8e50fc829 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-31 16:54:26 +08:00
yaziming
b3cdb231ac Backend:
1.[improve]
       使用gin提供的RouteGroup功能简化中间件逻辑
    2.[break change]
       移除Authorization Middleware中对登录注册下载特殊处理逻辑
    3.[unsafe problem]
       下载任务csv增加登录验证
Frontend:
    1. 更改csv下载方式
    2. task list页面table section 移除固定width设置,采用自适应,防止大屏空白断裂问题
2019-08-31 15:00:38 +08:00
陈景阳
cbd549255e fix 前端报错的问题 2019-08-31 13:50:01 +08:00
Marvin Zhang
eb247f2516 fixed upload bug 2019-07-29 20:30:39 +08:00
Marvin Zhang
92d443f19d optimized user auth 2019-07-27 14:55:03 +08:00
Marvin Zhang
087e8e65aa added user management 2019-07-27 00:56:28 +08:00
Marvin Zhang
607ad029dd added user login/signup 2019-07-26 23:02:30 +08:00
Marvin Zhang
946bb7ceba added spider stats 2019-07-26 17:07:24 +08:00
Marvin Zhang
2dc51c48fc updated file edit 2019-07-24 19:51:29 +08:00
Marvin Zhang
6b3a2a369f added file management 2019-07-24 13:37:03 +08:00
Marvin Zhang
0bd721795b code clean up 2019-07-23 21:09:08 +08:00
Marvin Zhang
c5620bc2d1 added system info 2019-07-23 20:08:29 +08:00
Marvin Zhang
c6bd35bd02 updated frontend to adapt changes of golang version 2019-07-22 12:32:36 +08:00
Marvin Zhang
67c299e5d9 adapt changes to golang api 2019-07-21 16:48:58 +08:00
Marvin Zhang
2b9cd566eb updated auto field extraction 2019-06-04 23:43:47 +08:00
Marvin Zhang
571acd9728 fixed issue https://github.com/tikazyq/crawlab/issues/45 2019-05-30 12:21:01 +08:00
Marvin Zhang
0b406937c9 added baidu tongji for analytics 2019-05-29 22:06:43 +08:00
Marvin Zhang
7492c34c4a added extracting list fields functionality 2019-05-29 17:51:44 +08:00
Marvin Zhang
d03197042d allow generate URLs by pattern 2019-05-28 14:59:21 +08:00
Marvin Zhang
113be056ae updated configurable spider 2019-05-26 19:17:02 +08:00
Marvin Zhang
5daebcb39b updated configurable spider 2019-05-26 17:10:04 +08:00
Marvin Zhang
15f9b7ef05 added configurable spider: add/edit fields, preview results 2019-05-25 20:18:27 +08:00
Marvin Zhang
04789febc8 prepared for configurable spiders 2019-05-24 17:28:25 +08:00
Marvin Zhang
c5a3d32579 updated SiteList 2019-05-22 22:33:43 +08:00
Marvin Zhang
1f015730c1 refactor code 2019-05-21 12:28:33 +08:00
Marvin Zhang
433b945eeb link site to spider 2019-05-10 13:27:13 +08:00
Marvin Zhang
93f9612b9b added site list 2019-05-09 22:28:12 +08:00
Marvin Zhang
e822c65eb2 added site list 2019-05-09 22:15:58 +08:00