Marvin Zhang
eb1a80ec2d
added param to task
2019-09-04 20:13:28 +08:00
Marvin Zhang
4893439ffb
added param to task
2019-09-04 20:13:12 +08:00
Marvin Zhang
3eee129a7c
added param to task
2019-09-04 20:13:12 +08:00
Marvin Zhang
1b7eea7e57
Merge pull request #210 from hantmac/develop
...
bug fix:fix data race caused by LockList
2019-09-04 14:14:45 +08:00
Marvin Zhang
992f3f4d86
Merge pull request #210 from hantmac/develop
...
bug fix:fix data race caused by LockList
2019-09-04 14:14:45 +08:00
hantmac
2fb1754e56
bug fix:fix data race caused by LockList
2019-09-04 13:51:02 +08:00
hantmac
fb58cc1a28
bug fix:fix data race caused by LockList
2019-09-04 13:51:02 +08:00
Marvin Zhang
4e17158a46
Merge pull request #208 from yaziming/v0.4.0-imporve-error-response
...
feat(backend): add some feat for error message system
2019-09-03 15:25:04 +08:00
Marvin Zhang
e93a471e89
Merge pull request #208 from yaziming/v0.4.0-imporve-error-response
...
feat(backend): add some feat for error message system
2019-09-03 15:25:04 +08:00
Marvin Zhang
a5449a674a
Merge pull request #209 from crawlab-team/revert-207-v0.4.0-imporve-error-response
...
Revert "V0.4.0 imporve error response"
2019-09-03 15:24:40 +08:00
Marvin Zhang
bb4ec17125
Merge pull request #209 from crawlab-team/revert-207-v0.4.0-imporve-error-response
...
Revert "V0.4.0 imporve error response"
2019-09-03 15:24:40 +08:00
Marvin Zhang
acccdb65bd
Revert "V0.4.0 imporve error response"
2019-09-03 15:24:26 +08:00
Marvin Zhang
9744f45e86
Revert "V0.4.0 imporve error response"
2019-09-03 15:24:26 +08:00
Marvin Zhang
e591986275
Merge pull request #207 from yaziming/v0.4.0-imporve-error-response
...
V0.4.0 imporve error response
2019-09-03 15:24:06 +08:00
Marvin Zhang
5925011510
Merge pull request #207 from yaziming/v0.4.0-imporve-error-response
...
V0.4.0 imporve error response
2019-09-03 15:24:06 +08:00
Marvin Zhang
53cce33d64
Merge pull request #206 from yaziming/v0.4.0-use-unsafe.pointer-convert-bytes-to-string
...
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
2019-09-03 15:23:37 +08:00
Marvin Zhang
a0df7a4e1e
Merge pull request #206 from yaziming/v0.4.0-use-unsafe.pointer-convert-bytes-to-string
...
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
2019-09-03 15:23:37 +08:00
yaziming
71c83251e5
feat(backend): add some feat for error message system
...
errors support custom http code and support return invalid validated
error
2019-09-03 15:23:08 +08:00
yaziming
8ee33d3762
feat(backend): add some feat for error message system
...
errors support custom http code and support return invalid validated
error
2019-09-03 15:23:08 +08:00
yaziming
e10d8fd996
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
...
detail:
1. add utils.BytesToString function instead of string() convert bytes to string.
2. use bytes.NewReader instead of strings.NewReader(string(sb)).
3. use w.Body.Bytes() instead of []byte(w.Body.String()).
2019-09-03 15:17:32 +08:00
yaziming
888a3cab79
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
...
detail:
1. add utils.BytesToString function instead of string() convert bytes to string.
2. use bytes.NewReader instead of strings.NewReader(string(sb)).
3. use w.Body.Bytes() instead of []byte(w.Body.String()).
2019-09-03 15:17:32 +08:00
Marvin Zhang
ae9f17716f
Merge pull request #205 from hantmac/develop
...
bug fix:fix go test ./..
2019-09-03 13:41:00 +08:00
Marvin Zhang
208c13c28c
Merge pull request #205 from hantmac/develop
...
bug fix:fix go test ./..
2019-09-03 13:41:00 +08:00
hantmac
cb3d7263b2
bug fix:fix go test ./.. bug
2019-09-03 12:47:18 +08:00
hantmac
2ffd1774bf
bug fix:fix go test ./.. bug
2019-09-03 12:47:18 +08:00
Marvin Zhang
3c244c7306
Merge pull request #204 from wo10378931/develop
...
fix 几个问题
2019-09-03 09:11:46 +08:00
Marvin Zhang
dff3ffd913
Merge pull request #204 from wo10378931/develop
...
fix 几个问题
2019-09-03 09:11:46 +08:00
陈景阳
cd78e6c745
还原代码
2019-09-03 09:06:04 +08:00
陈景阳
4255b2f6b6
还原代码
2019-09-03 09:06:04 +08:00
陈景阳
eb92d34f9b
Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop
2019-09-03 08:57:21 +08:00
陈景阳
9e9b117669
Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop
2019-09-03 08:57:21 +08:00
Marvin Zhang
ce08411960
Merge pull request #203 from yaziming/v0.4.0-mongo-redis-support-timeout-and-pool
...
add timeout and pool
2019-09-03 08:19:22 +08:00
Marvin Zhang
f514bed59d
Merge pull request #203 from yaziming/v0.4.0-mongo-redis-support-timeout-and-pool
...
add timeout and pool
2019-09-03 08:19:22 +08:00
yaziming
361134f8dd
Remove redundant fmt.Println
2019-09-02 22:57:29 +08:00
yaziming
ec328ae02b
Remove redundant fmt.Println
2019-09-02 22:57:29 +08:00
陈景阳
352fac4096
fix 删除spider没有删除task的问题
2019-09-02 20:49:00 +08:00
陈景阳
6675d075f2
fix 删除spider没有删除task的问题
2019-09-02 20:49:00 +08:00
yaziming
10c3488caf
break loop when subscribe count is 0
2019-09-02 18:32:47 +08:00
yaziming
2b579cc642
break loop when subscribe count is 0
2019-09-02 18:32:47 +08:00
陈景阳
b5084c964b
还原代码
2019-09-02 18:14:34 +08:00
陈景阳
41c3b98333
还原代码
2019-09-02 18:14:34 +08:00
陈景阳
8b237ddc2a
fix 无法正常删除有问题的爬虫
2019-09-02 18:04:47 +08:00
陈景阳
45aaaa2c46
fix 无法正常删除有问题的爬虫
2019-09-02 18:04:47 +08:00
陈景阳
93dd3b714a
fix 如果从dir读取爬虫为空，则移除所有的爬虫
2019-09-02 17:37:48 +08:00
陈景阳
69fc10fcc3
fix 如果从dir读取爬虫为空，则移除所有的爬虫
2019-09-02 17:37:48 +08:00
陈景阳
f9fdf5b8d8
fix 打印日志只有2KB
2019-09-02 16:45:56 +08:00
陈景阳
64a8fab961
fix 打印日志只有2KB
2019-09-02 16:45:56 +08:00
陈景阳
033ca493aa
添加排序
2019-09-02 10:40:16 +08:00
陈景阳
1e37d714b0
添加排序
2019-09-02 10:40:16 +08:00
陈景阳
eaf412dc80
Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop
2019-09-02 09:55:49 +08:00
