git-sync/crawlab
1
0
Fork 0
mirror of https://github.com/crawlab-team/crawlab.git synced 2026-01-23 17:31:11 +01:00
Code Issues Packages Projects Releases Wiki Activity
770 Commits 6 Branches 35 Tags
39d8a9ffd53833ee2df00d6ebdaab690bda45153
Commit Graph

770 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yaziming
39d8a9ffd5 Merge remote-tracking branch 'forked/develop' into forked_master 2019-09-04 20:42:01 +08:00
yaziming
6dc687192e Revert "Revert "V0.4.0 imporve error response"" 
This reverts commit 9744f45e86.
 2019-09-04 20:41:37 +08:00
Marvin Zhang
eb1a80ec2d added param to task 2019-09-04 20:13:28 +08:00
Marvin Zhang
3eee129a7c added param to task 2019-09-04 20:13:12 +08:00
Marvin Zhang
992f3f4d86 Merge pull request #210 from hantmac/develop 
bug fix:fix data race caused by LockList
 2019-09-04 14:14:45 +08:00
hantmac
fb58cc1a28 bug fix:fix data race caused by LockList 2019-09-04 13:51:02 +08:00
Marvin Zhang
e93a471e89 Merge pull request #208 from yaziming/v0.4.0-imporve-error-response 
feat(backend): add some feat for error message system
 2019-09-03 15:25:04 +08:00
Marvin Zhang
bb4ec17125 Merge pull request #209 from crawlab-team/revert-207-v0.4.0-imporve-error-response 
Revert "V0.4.0 imporve error response"
 2019-09-03 15:24:40 +08:00
Marvin Zhang
9744f45e86 Revert "V0.4.0 imporve error response" 2019-09-03 15:24:26 +08:00
Marvin Zhang
5925011510 Merge pull request #207 from yaziming/v0.4.0-imporve-error-response 
V0.4.0 imporve error response
 2019-09-03 15:24:06 +08:00
Marvin Zhang
a0df7a4e1e Merge pull request #206 from yaziming/v0.4.0-use-unsafe.pointer-convert-bytes-to-string 
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
 2019-09-03 15:23:37 +08:00
yaziming
8ee33d3762 feat(backend): add some feat for error message system 
errors support custom http code and support return invalid validated
error
 2019-09-03 15:23:08 +08:00
yaziming
888a3cab79 refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions 
detail:
    1. add utils.BytesToString function instead of string() convert bytes to string.
    2. use bytes.NewReader instead of strings.NewReader(string(sb)).
    3. use w.Body.Bytes() instead of []byte(w.Body.String()).
 2019-09-03 15:17:32 +08:00
Marvin Zhang
208c13c28c Merge pull request #205 from hantmac/develop 
bug fix:fix go test ./..
 2019-09-03 13:41:00 +08:00
hantmac
2ffd1774bf bug fix:fix go test ./.. bug 2019-09-03 12:47:18 +08:00
Marvin Zhang
dff3ffd913 Merge pull request #204 from wo10378931/develop 
fix 几个问题
 2019-09-03 09:11:46 +08:00
陈景阳
4255b2f6b6 还原代码 2019-09-03 09:06:04 +08:00
陈景阳
9e9b117669 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop 2019-09-03 08:57:21 +08:00
Marvin Zhang
f514bed59d Merge pull request #203 from yaziming/v0.4.0-mongo-redis-support-timeout-and-pool 
add timeout and pool
 2019-09-03 08:19:22 +08:00
yaziming
ec328ae02b Remove redundant fmt.Println 2019-09-02 22:57:29 +08:00
陈景阳
6675d075f2 fix 删除spider没有删除task的问题 2019-09-02 20:49:00 +08:00
yaziming
2b579cc642 break loop when subscribe count is 0 2019-09-02 18:32:47 +08:00
陈景阳
41c3b98333 还原代码 2019-09-02 18:14:34 +08:00
陈景阳
45aaaa2c46 fix 无法正常删除有问题的爬虫 2019-09-02 18:04:47 +08:00
陈景阳
69fc10fcc3 fix 如果从dir读取爬虫为空，则移除所有的爬虫 2019-09-02 17:37:48 +08:00
陈景阳
64a8fab961 fix 打印日志只有2KB 2019-09-02 16:45:56 +08:00
陈景阳
1e37d714b0 添加排序 2019-09-02 10:40:16 +08:00
陈景阳
abe6347159 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop 2019-09-02 09:55:49 +08:00
陈景阳
cce5bd71e8 fix 爬虫列表在小屏幕下错位的问题 2019-09-02 09:40:24 +08:00
yaziming
443d697c6f backend: 
1. Mongo dial add 5 seconds connection timeout.
 2. Redis uses connection pool mode.
 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.
 2019-09-01 17:18:08 +08:00
Marvin Zhang
d97134b288 Merge pull request #195 from hantmac/master 
bug fix:fix read log file oom
 2019-09-01 11:09:02 +08:00
Marvin Zhang
ce4155ea1a Merge pull request #197 from yaziming/0.4.x-develop 
Some Improve Fronted Work.
 2019-09-01 11:08:26 +08:00
Marvin Zhang
cded715d63 Merge pull request #198 from yaziming/v0.4.0-upgrade-govalidate-v8-to-v9 
upgrade validate v8 to v9
 2019-09-01 11:08:12 +08:00
yaziming
7574ceb0cf Backend: 
upgrade gin framework depend validator version : v8 -> v9
 2019-09-01 10:13:53 +08:00
yaziming
fc4ebe3753 1. Fix Some I18n Warning. 
2. Fix Navigation Duplicated Error When Current Route Path is `/login`.
3. Fix  Parent Level Named Route Warning.
4. Change `request` function From Promise Syntax To Await/Async.
 2019-09-01 00:36:59 +08:00
Jeremy
0d6bd8fb0a Merge branch 'develop' into master 2019-09-01 00:13:19 +08:00
hantmac
d5dfe648af add unit test for GetLocalLog 2019-09-01 00:07:18 +08:00
hantmac
7c0c490f1c bug fix:fix read log file oom 2019-09-01 00:06:26 +08:00
Marvin Zhang
f755b57a12 Merge pull request #194 from yaziming/0.4.x-develop 
improve.
 2019-08-31 22:56:07 +08:00
yaziming
9f43e08ff9 Backend: 
improve
     - AuthMiddleware 注入当前用户的信息
     - 增加Context服务支持快捷获取当前登录者信息
     - 重构Login/GetMe接口逻辑避免重复的数据库查询
     - 规范化error信息声明(向下兼容,旧代码可逐渐迁移规范化)
     - 修正部分不符合规范的代码
 2019-08-31 21:26:56 +08:00
Marvin Zhang
83c008868c Merge pull request #193 from wo10378931/v0.4.0 
FIX 一些问题
 2019-08-31 18:08:23 +08:00
陈景阳
e027aeb71f 添加日志打印 2019-08-31 17:56:42 +08:00
陈景阳
1a383dac17 fix 爬虫目录无法打开的问题 2019-08-31 17:04:49 +08:00
陈景阳
18d66d8ad3 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-31 16:54:26 +08:00
陈景阳
b32a4677d2 新增开发环境配置 2019-08-31 16:27:01 +08:00
陈景阳
7a901ff257 添加备注 
添加上次运行状态
 2019-08-31 16:09:41 +08:00
陈景阳
34cf672c93 优化代码 2019-08-31 16:00:24 +08:00
陈景阳
c0201f566a 优化代码 2019-08-31 15:59:43 +08:00
Marvin Zhang
5afc0ca490 Merge pull request #192 from yaziming/forked/develop 
Some Change.
 2019-08-31 15:15:35 +08:00
陈景阳
1877677844 fix 无法获取日志的问题 2019-08-31 15:03:57 +08:00