Commit Graph

  • 93dd3b714a fix 如果从dir读取爬虫为空,则移除所有的爬虫 陈景阳 2019-09-02 17:37:48 +08:00
  • 64a8fab961 fix 打印日志只有2KB 陈景阳 2019-09-02 16:45:56 +08:00
  • f9fdf5b8d8 fix 打印日志只有2KB 陈景阳 2019-09-02 16:45:56 +08:00
  • 1e37d714b0 添加排序 陈景阳 2019-09-02 10:40:16 +08:00
  • 033ca493aa 添加排序 陈景阳 2019-09-02 10:40:16 +08:00
  • abe6347159 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop 陈景阳 2019-09-02 09:55:49 +08:00
  • eaf412dc80 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop 陈景阳 2019-09-02 09:55:49 +08:00
  • cce5bd71e8 fix 爬虫列表在小屏幕下错位的问题 陈景阳 2019-09-02 09:40:24 +08:00
  • bc39f67890 fix 爬虫列表在小屏幕下错位的问题 陈景阳 2019-09-02 09:40:24 +08:00
  • 443d697c6f backend: 1. Mongo dial add 5 seconds connection timeout. 2. Redis uses connection pool mode. 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout. yaziming 2019-09-01 17:18:08 +08:00
  • a9346a0934 backend: 1. Mongo dial add 5 seconds connection timeout. 2. Redis uses connection pool mode. 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout. yaziming 2019-09-01 17:18:08 +08:00
  • d97134b288 Merge pull request #195 from hantmac/master Marvin Zhang 2019-09-01 11:09:02 +08:00
  • d0c5f25bfe Merge pull request #195 from hantmac/master Marvin Zhang 2019-09-01 11:09:02 +08:00
  • ce4155ea1a Merge pull request #197 from yaziming/0.4.x-develop Marvin Zhang 2019-09-01 11:08:26 +08:00
  • 8f04900be1 Merge pull request #197 from yaziming/0.4.x-develop Marvin Zhang 2019-09-01 11:08:26 +08:00
  • cded715d63 Merge pull request #198 from yaziming/v0.4.0-upgrade-govalidate-v8-to-v9 Marvin Zhang 2019-09-01 11:08:12 +08:00
  • 7e495c675d Merge pull request #198 from yaziming/v0.4.0-upgrade-govalidate-v8-to-v9 Marvin Zhang 2019-09-01 11:08:12 +08:00
  • 7574ceb0cf Backend: upgrade gin framework depend validator version : v8 -> v9 yaziming 2019-09-01 10:13:53 +08:00
  • c054b9bd33 Backend: upgrade gin framework depend validator version : v8 -> v9 yaziming 2019-09-01 10:13:53 +08:00
  • fc4ebe3753 1. Fix Some I18n Warning. 2. Fix Navigation Duplicated Error When Current Route Path is /login. 3. Fix Parent Level Named Route Warning. 4. Change request function From Promise Syntax To Await/Async. yaziming 2019-09-01 00:36:59 +08:00
  • 1c0b86428c 1. Fix Some I18n Warning. 2. Fix Navigation Duplicated Error When Current Route Path is /login. 3. Fix Parent Level Named Route Warning. 4. Change request function From Promise Syntax To Await/Async. yaziming 2019-09-01 00:36:59 +08:00
  • 0d6bd8fb0a Merge branch 'develop' into master Jeremy 2019-09-01 00:13:19 +08:00
  • 92c37a9e5c Merge branch 'develop' into master Jeremy 2019-09-01 00:13:19 +08:00
  • d5dfe648af add unit test for GetLocalLog hantmac 2019-09-01 00:07:18 +08:00
  • 1de80f7779 add unit test for GetLocalLog hantmac 2019-09-01 00:07:18 +08:00
  • 7c0c490f1c bug fix:fix read log file oom hantmac 2019-09-01 00:06:26 +08:00
  • b766be577a bug fix:fix read log file oom hantmac 2019-09-01 00:06:26 +08:00
  • f755b57a12 Merge pull request #194 from yaziming/0.4.x-develop Marvin Zhang 2019-08-31 22:56:07 +08:00
  • 36fbbe393a Merge pull request #194 from yaziming/0.4.x-develop Marvin Zhang 2019-08-31 22:56:07 +08:00
  • 9f43e08ff9 Backend: improve - AuthMiddleware 注入当前用户的信息 - 增加Context服务支持快捷获取当前登录者信息 - 重构Login/GetMe接口逻辑避免重复的数据库查询 - 规范化error信息声明(向下兼容,旧代码可逐渐迁移规范化) - 修正部分不符合规范的代码 yaziming 2019-08-31 21:22:47 +08:00
  • 81f6cf021f Backend: improve - AuthMiddleware 注入当前用户的信息 - 增加Context服务支持快捷获取当前登录者信息 - 重构Login/GetMe接口逻辑避免重复的数据库查询 - 规范化error信息声明(向下兼容,旧代码可逐渐迁移规范化) - 修正部分不符合规范的代码 yaziming 2019-08-31 21:22:47 +08:00
  • 83c008868c Merge pull request #193 from wo10378931/v0.4.0 Marvin Zhang 2019-08-31 18:08:23 +08:00
  • 55c6c6fd77 Merge pull request #193 from wo10378931/v0.4.0 Marvin Zhang 2019-08-31 18:08:23 +08:00
  • e027aeb71f 添加日志打印 陈景阳 2019-08-31 17:56:42 +08:00
  • b9ed176950 添加日志打印 陈景阳 2019-08-31 17:56:42 +08:00
  • 1a383dac17 fix 爬虫目录无法打开的问题 陈景阳 2019-08-31 17:04:49 +08:00
  • e423ff564c fix 爬虫目录无法打开的问题 陈景阳 2019-08-31 17:04:49 +08:00
  • 18d66d8ad3 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 陈景阳 2019-08-31 16:54:26 +08:00
  • f8e50fc829 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 陈景阳 2019-08-31 16:54:26 +08:00
  • b32a4677d2 新增开发环境配置 陈景阳 2019-08-31 16:27:01 +08:00
  • 2e3c754864 新增开发环境配置 陈景阳 2019-08-31 16:27:01 +08:00
  • 7a901ff257 添加备注 添加上次运行状态 陈景阳 2019-08-31 16:09:41 +08:00
  • 0a0f943264 添加备注 添加上次运行状态 陈景阳 2019-08-31 16:09:41 +08:00
  • 34cf672c93 优化代码 陈景阳 2019-08-31 16:00:24 +08:00
  • ececf8087e 优化代码 陈景阳 2019-08-31 16:00:24 +08:00
  • c0201f566a 优化代码 陈景阳 2019-08-31 15:59:43 +08:00
  • 8115f06496 优化代码 陈景阳 2019-08-31 15:59:43 +08:00
  • 5afc0ca490 Merge pull request #192 from yaziming/forked/develop Marvin Zhang 2019-08-31 15:15:35 +08:00
  • 3b468f92f4 Merge pull request #192 from yaziming/forked/develop Marvin Zhang 2019-08-31 15:15:35 +08:00
  • 1877677844 fix 无法获取日志的问题 陈景阳 2019-08-31 15:03:57 +08:00
  • 5e6aec2393 fix 无法获取日志的问题 陈景阳 2019-08-31 15:03:57 +08:00
  • d8acab7753 Backend: 1.[improve] 使用gin提供的RouteGroup功能简化中间件逻辑 2.[break change] 移除Authorization Middleware中对登录注册下载特殊处理逻辑 3.[unsafe problem] 下载任务csv增加登录验证 Frontend: 1. 更改csv下载方式 2. task list页面table section 移除固定width设置,采用自适应,防止大屏空白断裂问题 yaziming 2019-08-31 14:57:09 +08:00
  • b3cdb231ac Backend: 1.[improve] 使用gin提供的RouteGroup功能简化中间件逻辑 2.[break change] 移除Authorization Middleware中对登录注册下载特殊处理逻辑 3.[unsafe problem] 下载任务csv增加登录验证 Frontend: 1. 更改csv下载方式 2. task list页面table section 移除固定width设置,采用自适应,防止大屏空白断裂问题 yaziming 2019-08-31 14:57:09 +08:00
  • ecaf31f0f0 优化代码 陈景阳 2019-08-31 13:57:14 +08:00
  • b61445acb0 优化代码 陈景阳 2019-08-31 13:57:14 +08:00
  • f750fe5f8a fix 前端报错的问题 陈景阳 2019-08-31 13:50:01 +08:00
  • cbd549255e fix 前端报错的问题 陈景阳 2019-08-31 13:50:01 +08:00
  • 494601ab62 fix 节点注册异常情况 陈景阳 2019-08-31 13:49:34 +08:00
  • 4944883f95 fix 节点注册异常情况 陈景阳 2019-08-31 13:49:34 +08:00
  • e43332b34f FIX #178 FIX 当日志文件小于2048的时候无法正常拉取日志的问题 陈景阳 2019-08-31 12:42:53 +08:00
  • 57dddc84ed FIX #178 FIX 当日志文件小于2048的时候无法正常拉取日志的问题 陈景阳 2019-08-31 12:42:53 +08:00
  • 88d8810b3a Merge pull request #191 from wo10378931/v0.4.0 Marvin Zhang 2019-08-31 12:15:34 +08:00
  • 3625f74221 Merge pull request #191 from wo10378931/v0.4.0 Marvin Zhang 2019-08-31 12:15:34 +08:00
  • 5af4311b39 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 陈景阳 2019-08-31 12:09:06 +08:00
  • 53ab5b6016 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 陈景阳 2019-08-31 12:09:06 +08:00
  • c634e2b5cf fix 前端控制台报错的问题 \ fix 无法打印中文的问题 陈景阳 2019-08-31 12:04:12 +08:00
  • 771cb76277 fix 前端控制台报错的问题 \ fix 无法打印中文的问题 陈景阳 2019-08-31 12:04:12 +08:00
  • 1ba497b8f6 Merge pull request #189 from wo10378931/v0.4.0 Marvin Zhang 2019-08-31 11:44:45 +08:00
  • 14409d5869 Merge pull request #189 from wo10378931/v0.4.0 Marvin Zhang 2019-08-31 11:44:45 +08:00
  • dcad7bf2ca Merge pull request #190 from hantmac/master Marvin Zhang 2019-08-31 11:44:17 +08:00
  • c0cb6fd3e1 Merge pull request #190 from hantmac/master Marvin Zhang 2019-08-31 11:44:17 +08:00
  • 444784d5b6 Add unit test for log.go hantmac 2019-08-31 11:30:41 +08:00
  • 39a2a3d635 Add unit test for log.go hantmac 2019-08-31 11:30:41 +08:00
  • 80b92e1084 Init delete log files periodically hantmac 2019-08-31 11:30:01 +08:00
  • f4a5dfa503 Init delete log files periodically hantmac 2019-08-31 11:30:01 +08:00
  • a9fc1951c8 Add delete log files periodically hantmac 2019-08-31 11:29:24 +08:00
  • 5720f3f277 Add delete log files periodically hantmac 2019-08-31 11:29:24 +08:00
  • 95faaa0038 add option for config.yml to config log delete periodically hantmac 2019-08-31 11:28:16 +08:00
  • 8b50e12681 add option for config.yml to config log delete periodically hantmac 2019-08-31 11:28:16 +08:00
  • 9db9365a2c fix #184 陈景阳 2019-08-31 10:08:37 +08:00
  • 369ef02fc7 fix #184 陈景阳 2019-08-31 10:08:37 +08:00
  • 8633e851a5 Merge pull request #187 from hantmac/master Marvin Zhang 2019-08-30 18:05:18 +08:00
  • ab554fa297 Merge pull request #187 from hantmac/master Marvin Zhang 2019-08-30 18:05:18 +08:00
  • c481c66484 bug fix: hot fix out of memory problem caused by log read hantmac 2019-08-30 18:01:22 +08:00
  • 782e5694e6 bug fix: hot fix out of memory problem caused by log read hantmac 2019-08-30 18:01:22 +08:00
  • 0512757166 bug fix: hot fix out of memory problem caused by log read hantmac 2019-08-30 17:58:58 +08:00
  • 1b29a27ab0 bug fix: hot fix out of memory problem caused by log read hantmac 2019-08-30 17:58:58 +08:00
  • f098546a65 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 陈景阳 2019-08-28 16:00:27 +08:00
  • d5dce56712 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 陈景阳 2019-08-28 16:00:27 +08:00
  • 1736d00161 添加打印日志 陈景阳 2019-08-28 16:00:09 +08:00
  • cae11e3796 添加打印日志 陈景阳 2019-08-28 16:00:09 +08:00
  • 03e99d6872 Merge pull request #179 from hantmac/master Marvin Zhang 2019-08-27 14:24:23 +08:00
  • 8efc90353e Merge pull request #179 from hantmac/master Marvin Zhang 2019-08-27 14:24:23 +08:00
  • db81982725 bug fix: fix test failed for config.go hantmac 2019-08-27 14:21:39 +08:00
  • 36eaad64a5 bug fix: fix test failed for config.go hantmac 2019-08-27 14:21:39 +08:00
  • 0186d08112 删除爬虫顺带删除文件 陈景阳 2019-08-27 09:39:16 +08:00
  • c7e137a6aa 删除爬虫顺带删除文件 陈景阳 2019-08-27 09:39:16 +08:00
  • 2bcd147a60 Merge pull request #176 from yaziming/forked/develop Marvin Zhang 2019-08-27 08:45:49 +08:00
  • 9bd7c6670f Merge pull request #176 from yaziming/forked/develop Marvin Zhang 2019-08-27 08:45:49 +08:00
  • b11f31ec18 JSON -> AbortWithStatusJSON yaziming 2019-08-26 23:13:26 +08:00