Commit Graph

740 Commits

Author SHA1 Message Date
Marvin Zhang
d0c5f25bfe Merge pull request #195 from hantmac/master
bug fix:fix read log file oom
2019-09-01 11:09:02 +08:00
Marvin Zhang
8f04900be1 Merge pull request #197 from yaziming/0.4.x-develop
Some Improve Fronted Work.
2019-09-01 11:08:26 +08:00
Marvin Zhang
7e495c675d Merge pull request #198 from yaziming/v0.4.0-upgrade-govalidate-v8-to-v9
upgrade validate v8 to v9
2019-09-01 11:08:12 +08:00
yaziming
c054b9bd33 Backend:
upgrade gin framework depend validator version : v8 -> v9
2019-09-01 10:13:53 +08:00
yaziming
1c0b86428c 1. Fix Some I18n Warning.
2. Fix Navigation Duplicated Error When Current Route Path is `/login`.
3. Fix  Parent Level Named Route Warning.
4. Change `request` function From Promise Syntax To Await/Async.
2019-09-01 00:36:59 +08:00
Jeremy
92c37a9e5c Merge branch 'develop' into master 2019-09-01 00:13:19 +08:00
hantmac
1de80f7779 add unit test for GetLocalLog 2019-09-01 00:07:18 +08:00
hantmac
b766be577a bug fix:fix read log file oom 2019-09-01 00:06:26 +08:00
Marvin Zhang
36fbbe393a Merge pull request #194 from yaziming/0.4.x-develop
improve.
2019-08-31 22:56:07 +08:00
yaziming
81f6cf021f Backend:
improve
     - AuthMiddleware 注入当前用户的信息
     - 增加Context服务支持快捷获取当前登录者信息
     - 重构Login/GetMe接口逻辑避免重复的数据库查询
     - 规范化error信息声明(向下兼容,旧代码可逐渐迁移规范化)
     - 修正部分不符合规范的代码
2019-08-31 21:26:56 +08:00
Marvin Zhang
55c6c6fd77 Merge pull request #193 from wo10378931/v0.4.0
FIX 一些问题
2019-08-31 18:08:23 +08:00
陈景阳
b9ed176950 添加日志打印 2019-08-31 17:56:42 +08:00
陈景阳
e423ff564c fix 爬虫目录无法打开的问题 2019-08-31 17:04:49 +08:00
陈景阳
f8e50fc829 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-31 16:54:26 +08:00
陈景阳
2e3c754864 新增开发环境配置 2019-08-31 16:27:01 +08:00
陈景阳
0a0f943264 添加备注
添加上次运行状态
2019-08-31 16:09:41 +08:00
陈景阳
ececf8087e 优化代码 2019-08-31 16:00:24 +08:00
陈景阳
8115f06496 优化代码 2019-08-31 15:59:43 +08:00
Marvin Zhang
3b468f92f4 Merge pull request #192 from yaziming/forked/develop
Some Change.
2019-08-31 15:15:35 +08:00
陈景阳
5e6aec2393 fix 无法获取日志的问题 2019-08-31 15:03:57 +08:00
yaziming
b3cdb231ac Backend:
1.[improve]
       使用gin提供的RouteGroup功能简化中间件逻辑
    2.[break change]
       移除Authorization Middleware中对登录注册下载特殊处理逻辑
    3.[unsafe problem]
       下载任务csv增加登录验证
Frontend:
    1. 更改csv下载方式
    2. task list页面table section 移除固定width设置,采用自适应,防止大屏空白断裂问题
2019-08-31 15:00:38 +08:00
陈景阳
b61445acb0 优化代码 2019-08-31 13:57:14 +08:00
陈景阳
cbd549255e fix 前端报错的问题 2019-08-31 13:50:01 +08:00
陈景阳
4944883f95 fix 节点注册异常情况 2019-08-31 13:49:34 +08:00
陈景阳
57dddc84ed FIX #178
FIX 当日志文件小于2048的时候无法正常拉取日志的问题
2019-08-31 12:42:53 +08:00
Marvin Zhang
3625f74221 Merge pull request #191 from wo10378931/v0.4.0
三个FIX
2019-08-31 12:15:34 +08:00
陈景阳
53ab5b6016 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-31 12:09:06 +08:00
陈景阳
771cb76277 fix 前端控制台报错的问题 \
fix 无法打印中文的问题
2019-08-31 12:04:12 +08:00
Marvin Zhang
14409d5869 Merge pull request #189 from wo10378931/v0.4.0
两个fix
2019-08-31 11:44:45 +08:00
Marvin Zhang
c0cb6fd3e1 Merge pull request #190 from hantmac/master
Add delete log files periodically
2019-08-31 11:44:17 +08:00
hantmac
39a2a3d635 Add unit test for log.go 2019-08-31 11:30:41 +08:00
hantmac
f4a5dfa503 Init delete log files periodically 2019-08-31 11:30:01 +08:00
hantmac
5720f3f277 Add delete log files periodically 2019-08-31 11:29:24 +08:00
hantmac
8b50e12681 add option for config.yml to config log delete periodically 2019-08-31 11:28:16 +08:00
陈景阳
369ef02fc7 fix #184 2019-08-31 10:08:37 +08:00
Marvin Zhang
ab554fa297 Merge pull request #187 from hantmac/master
bug fix: hot fix out of memory problem caused by log read
2019-08-30 18:05:18 +08:00
hantmac
782e5694e6 bug fix: hot fix out of memory problem caused by log read 2019-08-30 18:01:22 +08:00
hantmac
1b29a27ab0 bug fix: hot fix out of memory problem caused by log read 2019-08-30 17:58:58 +08:00
陈景阳
d5dce56712 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-28 16:00:27 +08:00
陈景阳
cae11e3796 添加打印日志 2019-08-28 16:00:09 +08:00
Marvin Zhang
8efc90353e Merge pull request #179 from hantmac/master
bug fix: fix test failed for config.go
2019-08-27 14:24:23 +08:00
hantmac
36eaad64a5 bug fix: fix test failed for config.go 2019-08-27 14:21:39 +08:00
陈景阳
c7e137a6aa 删除爬虫顺带删除文件 2019-08-27 09:39:16 +08:00
Marvin Zhang
9bd7c6670f Merge pull request #176 from yaziming/forked/develop
JSON -> AbortWithStatusJSON
2019-08-27 08:45:49 +08:00
yaziming
ba0471355b JSON -> AbortWithStatusJSON 2019-08-26 23:13:26 +08:00
Marvin Zhang
40fd77be13 Merge pull request #175 from hantmac/master
add unit test for routes/spider.go
2019-08-26 22:16:06 +08:00
hantmac
5e707adad4 add unit test for routes/spider.go 2019-08-26 21:10:55 +08:00
陈景阳
986a88e264 Merge branch 'master' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-26 20:36:18 +08:00
Marvin Zhang
489f53842f Merge pull request #173 from hantmac/master
bug fix:fix permission bug when create spiders dir caused by umask
2019-08-26 18:25:28 +08:00
hantmac
007f10b83b bug fix:fix permission bug when create spiders dir caused by umask 2019-08-26 17:44:01 +08:00