Commit Graph

49 Commits

Author SHA1 Message Date
marvzhang
e3f4bcd0ab updated stats 2020-01-22 11:07:38 +08:00
marvzhang
ef2a4b3531 加入树形结构文件目录 2020-01-15 17:44:11 +08:00
marvzhang
c67c1be52a 加入用户设置与邮件通知 2020-01-13 19:56:13 +08:00
marvzhang
877289e382 fixed https://github.com/crawlab-team/crawlab/issues/423 2020-01-06 12:35:17 +08:00
marvzhang
7835de2641 爬虫详情显示定时任务 2020-01-03 17:20:24 +08:00
marvzhang
33fbf96efb 优化代码 2020-01-03 11:12:46 +08:00
marvzhang
98cc4646a3 优化依赖安装 2020-01-03 10:54:20 +08:00
marvzhang
53c77eb6e9 加入卸载依赖逻辑 2020-01-02 17:38:39 +08:00
marvzhang
836dc12703 加入RPC机制,完成部分依赖安装逻辑 2020-01-02 15:53:53 +08:00
marvzhang
32b1f31340 加入依赖安装前端 2019-12-31 17:05:15 +08:00
marvzhang
5811242af9 更新依赖安装逻辑 2019-12-31 12:02:47 +08:00
marvzhang
01aea28c9c 添加文件管理功能(后端) 2019-12-25 20:49:43 +08:00
marvzhang
fdcf12f866 优化添加爬虫逻辑 2019-12-25 19:46:09 +08:00
marvzhang
27b167bc06 加入爬虫文件管理后端 API 2019-12-24 09:12:35 +08:00
marvzhang
936adf6f76 加入爬虫文件管理后端 API 2019-12-24 09:11:42 +08:00
marvzhang
ed7f933aee fixed https://github.com/crawlab-team/crawlab/issues/346 2019-12-20 12:45:37 +08:00
hantmac
3ab85ef226 Add API GetVersion 2019-12-19 21:16:25 +08:00
陈景阳
f9f04093d9 完成批量删除Task任务列表 2019-12-08 10:58:02 +08:00
陈景阳
58df4c4a96 Feature 新增定时任务可暂停/运行 2019-12-07 14:02:54 +08:00
hantmac
07ce8e25fd - 新增authGroup.DELETE("/tasks_by_status", routes.DeleteTaskByStatus) 支持批量删除指定状态的任务
- TaskListRequestData中增加Status字段,支持根据task状态进行筛选
2019-12-05 15:12:32 +08:00
hantmac
c230e393d7 fix 2019-12-04 16:48:36 +08:00
marvzhang
98cbccb81e 加入Spiderfile模版 2019-12-03 13:37:41 +08:00
marvzhang
d65e37517e 优化可配置爬虫前端界面 2019-11-28 21:36:17 +08:00
marvzhang
8210fa6c20 加入修改可配置POST接口 2019-11-28 16:08:13 +08:00
marvzhang
1674dce3bd 准备前端可配置爬虫数据 2019-11-27 10:40:37 +08:00
marvzhang
0d8ce3a29f 准备可配置爬虫后端数据 2019-11-26 13:38:54 +08:00
marvzhang
7003951561 fixed https://github.com/crawlab-team/crawlab/issues/315 2019-11-24 12:20:44 +08:00
marvzhang
7b86d35a0f code cleanup 2019-11-23 18:16:24 +08:00
marvzhang
607ce70f5c 准备可配置爬虫 2019-11-23 18:13:47 +08:00
yaziming
63fab3917b feat(backend): support server graceful down
1.support server graceful down
2019-10-09 11:21:01 +08:00
陈景阳
cdd7696295 添加爬虫类型 2019-09-30 14:43:48 +08:00
陈景阳
5f158ddb44 完成爬虫获取 2019-09-26 19:12:02 +08:00
yaziming
c054b9bd33 Backend:
upgrade gin framework depend validator version : v8 -> v9
2019-09-01 10:13:53 +08:00
Marvin Zhang
3b468f92f4 Merge pull request #192 from yaziming/forked/develop
Some Change.
2019-08-31 15:15:35 +08:00
yaziming
b3cdb231ac Backend:
1.[improve]
       使用gin提供的RouteGroup功能简化中间件逻辑
    2.[break change]
       移除Authorization Middleware中对登录注册下载特殊处理逻辑
    3.[unsafe problem]
       下载任务csv增加登录验证
Frontend:
    1. 更改csv下载方式
    2. task list页面table section 移除固定width设置,采用自适应,防止大屏空白断裂问题
2019-08-31 15:00:38 +08:00
hantmac
f4a5dfa503 Init delete log files periodically 2019-08-31 11:30:01 +08:00
陈景阳
4b8248ab5b ADD 启动错误日志打印 2019-08-03 14:27:19 +08:00
Marvin Zhang
e322060c08 Merge pull request #88 from wo10378931/master
FIX Node节点删除问题
2019-07-30 17:13:45 +08:00
陈景阳
24cba1dfaf fix Node节点删除问题 2019-07-30 16:06:35 +08:00
Marvin Zhang
83babba43f fixed upload bug 2019-07-29 20:31:44 +08:00
Marvin Zhang
80449a8d39 optimized user auth 2019-07-27 14:55:24 +08:00
Marvin Zhang
0c8aa3c43b added jwt 2019-07-27 00:00:59 +08:00
Marvin Zhang
607ad029dd added user login/signup 2019-07-26 23:02:30 +08:00
Marvin Zhang
946bb7ceba added spider stats 2019-07-26 17:07:24 +08:00
Marvin Zhang
bd7a9e27c7 added file edit 2019-07-24 19:51:52 +08:00
Marvin Zhang
6b3a2a369f added file management 2019-07-24 13:37:03 +08:00
Marvin Zhang
1e0449e415 fetch sysinfo from remote 2019-07-22 22:25:29 +08:00
Marvin Zhang
9f5664084a added sysinfo 2019-07-22 13:33:09 +08:00
Marvin Zhang
56c99b314f added golang 2019-07-22 12:51:52 +08:00