Marvin Zhang
bb4ec17125
Merge pull request #209 from crawlab-team/revert-207-v0.4.0-imporve-error-response
...
Revert "V0.4.0 imporve error response"
2019-09-03 15:24:40 +08:00
Marvin Zhang
acccdb65bd
Revert "V0.4.0 imporve error response"
2019-09-03 15:24:26 +08:00
Marvin Zhang
9744f45e86
Revert "V0.4.0 imporve error response"
2019-09-03 15:24:26 +08:00
Marvin Zhang
e591986275
Merge pull request #207 from yaziming/v0.4.0-imporve-error-response
...
V0.4.0 imporve error response
2019-09-03 15:24:06 +08:00
Marvin Zhang
5925011510
Merge pull request #207 from yaziming/v0.4.0-imporve-error-response
...
V0.4.0 imporve error response
2019-09-03 15:24:06 +08:00
Marvin Zhang
53cce33d64
Merge pull request #206 from yaziming/v0.4.0-use-unsafe.pointer-convert-bytes-to-string
...
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
2019-09-03 15:23:37 +08:00
Marvin Zhang
a0df7a4e1e
Merge pull request #206 from yaziming/v0.4.0-use-unsafe.pointer-convert-bytes-to-string
...
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
2019-09-03 15:23:37 +08:00
yaziming
71c83251e5
feat(backend): add some feat for error message system
...
errors support custom http code and support return invalid validated
error
2019-09-03 15:23:08 +08:00
yaziming
8ee33d3762
feat(backend): add some feat for error message system
...
errors support custom http code and support return invalid validated
error
2019-09-03 15:23:08 +08:00
yaziming
e10d8fd996
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
...
detail:
1. add utils.BytesToString function instead of string() convert bytes to string.
2. use bytes.NewReader instead of strings.NewReader(string(sb)).
3. use w.Body.Bytes() instead of []byte(w.Body.String()).
2019-09-03 15:17:32 +08:00
yaziming
888a3cab79
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
...
detail:
1. add utils.BytesToString function instead of string() convert bytes to string.
2. use bytes.NewReader instead of strings.NewReader(string(sb)).
3. use w.Body.Bytes() instead of []byte(w.Body.String()).
2019-09-03 15:17:32 +08:00
Marvin Zhang
ae9f17716f
Merge pull request #205 from hantmac/develop
...
bug fix:fix go test ./..
2019-09-03 13:41:00 +08:00
Marvin Zhang
208c13c28c
Merge pull request #205 from hantmac/develop
...
bug fix:fix go test ./..
2019-09-03 13:41:00 +08:00
hantmac
cb3d7263b2
bug fix:fix go test ./.. bug
2019-09-03 12:47:18 +08:00
hantmac
2ffd1774bf
bug fix:fix go test ./.. bug
2019-09-03 12:47:18 +08:00
Marvin Zhang
3c244c7306
Merge pull request #204 from wo10378931/develop
...
fix 几个问题
2019-09-03 09:11:46 +08:00
Marvin Zhang
dff3ffd913
Merge pull request #204 from wo10378931/develop
...
fix 几个问题
2019-09-03 09:11:46 +08:00
陈景阳
cd78e6c745
还原代码
2019-09-03 09:06:04 +08:00
陈景阳
4255b2f6b6
还原代码
2019-09-03 09:06:04 +08:00
陈景阳
eb92d34f9b
Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop
2019-09-03 08:57:21 +08:00
陈景阳
9e9b117669
Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop
2019-09-03 08:57:21 +08:00
Marvin Zhang
ce08411960
Merge pull request #203 from yaziming/v0.4.0-mongo-redis-support-timeout-and-pool
...
add timeout and pool
2019-09-03 08:19:22 +08:00
Marvin Zhang
f514bed59d
Merge pull request #203 from yaziming/v0.4.0-mongo-redis-support-timeout-and-pool
...
add timeout and pool
2019-09-03 08:19:22 +08:00
yaziming
361134f8dd
Remove redundant fmt.Println
2019-09-02 22:57:29 +08:00
yaziming
ec328ae02b
Remove redundant fmt.Println
2019-09-02 22:57:29 +08:00
陈景阳
352fac4096
fix 删除spider没有删除task的问题
2019-09-02 20:49:00 +08:00
陈景阳
6675d075f2
fix 删除spider没有删除task的问题
2019-09-02 20:49:00 +08:00
yaziming
10c3488caf
break loop when subscribe count is 0
2019-09-02 18:32:47 +08:00
yaziming
2b579cc642
break loop when subscribe count is 0
2019-09-02 18:32:47 +08:00
陈景阳
b5084c964b
还原代码
2019-09-02 18:14:34 +08:00
陈景阳
41c3b98333
还原代码
2019-09-02 18:14:34 +08:00
陈景阳
8b237ddc2a
fix 无法正常删除有问题的爬虫
2019-09-02 18:04:47 +08:00
陈景阳
45aaaa2c46
fix 无法正常删除有问题的爬虫
2019-09-02 18:04:47 +08:00
陈景阳
93dd3b714a
fix 如果从dir读取爬虫为空，则移除所有的爬虫
2019-09-02 17:37:48 +08:00
陈景阳
69fc10fcc3
fix 如果从dir读取爬虫为空，则移除所有的爬虫
2019-09-02 17:37:48 +08:00
陈景阳
f9fdf5b8d8
fix 打印日志只有2KB
2019-09-02 16:45:56 +08:00
陈景阳
64a8fab961
fix 打印日志只有2KB
2019-09-02 16:45:56 +08:00
陈景阳
033ca493aa
添加排序
2019-09-02 10:40:16 +08:00
陈景阳
1e37d714b0
添加排序
2019-09-02 10:40:16 +08:00
陈景阳
eaf412dc80
Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop
2019-09-02 09:55:49 +08:00
陈景阳
abe6347159
Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop
2019-09-02 09:55:49 +08:00
陈景阳
bc39f67890
fix 爬虫列表在小屏幕下错位的问题
2019-09-02 09:40:24 +08:00
陈景阳
cce5bd71e8
fix 爬虫列表在小屏幕下错位的问题
2019-09-02 09:40:24 +08:00
yaziming
a9346a0934
backend:
...
1. Mongo dial add 5 seconds connection timeout.
2. Redis uses connection pool mode.
3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.
2019-09-01 17:18:08 +08:00
yaziming
443d697c6f
backend:
...
1. Mongo dial add 5 seconds connection timeout.
2. Redis uses connection pool mode.
3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.
2019-09-01 17:18:08 +08:00
Marvin Zhang
d0c5f25bfe
Merge pull request #195 from hantmac/master
...
bug fix:fix read log file oom
2019-09-01 11:09:02 +08:00
Marvin Zhang
d97134b288
Merge pull request #195 from hantmac/master
...
bug fix:fix read log file oom
2019-09-01 11:09:02 +08:00
Marvin Zhang
8f04900be1
Merge pull request #197 from yaziming/0.4.x-develop
...
Some Improve Fronted Work.
2019-09-01 11:08:26 +08:00
Marvin Zhang
ce4155ea1a
Merge pull request #197 from yaziming/0.4.x-develop
...
Some Improve Fronted Work.
2019-09-01 11:08:26 +08:00
Marvin Zhang
7e495c675d
Merge pull request #198 from yaziming/v0.4.0-upgrade-govalidate-v8-to-v9
...
upgrade validate v8 to v9
2019-09-01 11:08:12 +08:00
