Commit Graph

5948 Commits

Author SHA1 Message Date
陈景阳
cdeef4b4a5 重构msg的包 2019-09-10 09:32:48 +08:00
陈景阳
9514a8a6af 重构msg的包 2019-09-10 09:32:48 +08:00
陈景阳
8cf48d871e fix 删除spider没有删除task 2019-09-05 20:07:08 +08:00
陈景阳
e5d33b8982 fix 删除spider没有删除task 2019-09-05 20:07:08 +08:00
Marvin Zhang
2e496964fd Merge pull request #214 from crawlab-team/master
Master to Develop
2019-09-04 20:57:15 +08:00
Marvin Zhang
07cd8fb01a Merge pull request #214 from crawlab-team/master
Master to Develop
2019-09-04 20:57:15 +08:00
Marvin Zhang
166c49550c Merge pull request #213 from yaziming/forked_master
Merge  master
2019-09-04 20:56:16 +08:00
Marvin Zhang
35e198b885 Merge pull request #213 from yaziming/forked_master
Merge  master
2019-09-04 20:56:16 +08:00
yaziming
2bd8891889 Merge remote-tracking branch 'forked/develop' into forked_master 2019-09-04 20:42:01 +08:00
yaziming
39d8a9ffd5 Merge remote-tracking branch 'forked/develop' into forked_master 2019-09-04 20:42:01 +08:00
yaziming
5e2b3ca228 Revert "Revert "V0.4.0 imporve error response""
This reverts commit acccdb65bd.
2019-09-04 20:41:37 +08:00
yaziming
6dc687192e Revert "Revert "V0.4.0 imporve error response""
This reverts commit 9744f45e86.
2019-09-04 20:41:37 +08:00
Marvin Zhang
5013233481 added param to task 2019-09-04 20:13:28 +08:00
Marvin Zhang
eb1a80ec2d added param to task 2019-09-04 20:13:28 +08:00
Marvin Zhang
4893439ffb added param to task 2019-09-04 20:13:12 +08:00
Marvin Zhang
3eee129a7c added param to task 2019-09-04 20:13:12 +08:00
Marvin Zhang
1b7eea7e57 Merge pull request #210 from hantmac/develop
bug fix:fix data race caused by LockList
2019-09-04 14:14:45 +08:00
Marvin Zhang
992f3f4d86 Merge pull request #210 from hantmac/develop
bug fix:fix data race caused by LockList
2019-09-04 14:14:45 +08:00
hantmac
2fb1754e56 bug fix:fix data race caused by LockList 2019-09-04 13:51:02 +08:00
hantmac
fb58cc1a28 bug fix:fix data race caused by LockList 2019-09-04 13:51:02 +08:00
Marvin Zhang
4e17158a46 Merge pull request #208 from yaziming/v0.4.0-imporve-error-response
feat(backend): add some feat for error message system
2019-09-03 15:25:04 +08:00
Marvin Zhang
e93a471e89 Merge pull request #208 from yaziming/v0.4.0-imporve-error-response
feat(backend): add some feat for error message system
2019-09-03 15:25:04 +08:00
Marvin Zhang
a5449a674a Merge pull request #209 from crawlab-team/revert-207-v0.4.0-imporve-error-response
Revert "V0.4.0 imporve error response"
2019-09-03 15:24:40 +08:00
Marvin Zhang
bb4ec17125 Merge pull request #209 from crawlab-team/revert-207-v0.4.0-imporve-error-response
Revert "V0.4.0 imporve error response"
2019-09-03 15:24:40 +08:00
Marvin Zhang
acccdb65bd Revert "V0.4.0 imporve error response" 2019-09-03 15:24:26 +08:00
Marvin Zhang
9744f45e86 Revert "V0.4.0 imporve error response" 2019-09-03 15:24:26 +08:00
Marvin Zhang
e591986275 Merge pull request #207 from yaziming/v0.4.0-imporve-error-response
V0.4.0 imporve error response
2019-09-03 15:24:06 +08:00
Marvin Zhang
5925011510 Merge pull request #207 from yaziming/v0.4.0-imporve-error-response
V0.4.0 imporve error response
2019-09-03 15:24:06 +08:00
Marvin Zhang
53cce33d64 Merge pull request #206 from yaziming/v0.4.0-use-unsafe.pointer-convert-bytes-to-string
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
2019-09-03 15:23:37 +08:00
Marvin Zhang
a0df7a4e1e Merge pull request #206 from yaziming/v0.4.0-use-unsafe.pointer-convert-bytes-to-string
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
2019-09-03 15:23:37 +08:00
yaziming
71c83251e5 feat(backend): add some feat for error message system
errors support custom http code and support return invalid validated
error
2019-09-03 15:23:08 +08:00
yaziming
8ee33d3762 feat(backend): add some feat for error message system
errors support custom http code and support return invalid validated
error
2019-09-03 15:23:08 +08:00
yaziming
e10d8fd996 refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
detail:
    1. add utils.BytesToString function instead of string() convert bytes to string.
    2. use bytes.NewReader instead of strings.NewReader(string(sb)).
    3. use w.Body.Bytes() instead of []byte(w.Body.String()).
2019-09-03 15:17:32 +08:00
yaziming
888a3cab79 refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
detail:
    1. add utils.BytesToString function instead of string() convert bytes to string.
    2. use bytes.NewReader instead of strings.NewReader(string(sb)).
    3. use w.Body.Bytes() instead of []byte(w.Body.String()).
2019-09-03 15:17:32 +08:00
Marvin Zhang
ae9f17716f Merge pull request #205 from hantmac/develop
bug fix:fix go test ./..
2019-09-03 13:41:00 +08:00
Marvin Zhang
208c13c28c Merge pull request #205 from hantmac/develop
bug fix:fix go test ./..
2019-09-03 13:41:00 +08:00
hantmac
cb3d7263b2 bug fix:fix go test ./.. bug 2019-09-03 12:47:18 +08:00
hantmac
2ffd1774bf bug fix:fix go test ./.. bug 2019-09-03 12:47:18 +08:00
Marvin Zhang
3c244c7306 Merge pull request #204 from wo10378931/develop
fix 几个问题
2019-09-03 09:11:46 +08:00
Marvin Zhang
dff3ffd913 Merge pull request #204 from wo10378931/develop
fix 几个问题
2019-09-03 09:11:46 +08:00
陈景阳
cd78e6c745 还原代码 2019-09-03 09:06:04 +08:00
陈景阳
4255b2f6b6 还原代码 2019-09-03 09:06:04 +08:00
陈景阳
eb92d34f9b Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop 2019-09-03 08:57:21 +08:00
陈景阳
9e9b117669 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop 2019-09-03 08:57:21 +08:00
Marvin Zhang
ce08411960 Merge pull request #203 from yaziming/v0.4.0-mongo-redis-support-timeout-and-pool
add timeout and pool
2019-09-03 08:19:22 +08:00
Marvin Zhang
f514bed59d Merge pull request #203 from yaziming/v0.4.0-mongo-redis-support-timeout-and-pool
add timeout and pool
2019-09-03 08:19:22 +08:00
yaziming
361134f8dd Remove redundant fmt.Println 2019-09-02 22:57:29 +08:00
yaziming
ec328ae02b Remove redundant fmt.Println 2019-09-02 22:57:29 +08:00
陈景阳
352fac4096 fix 删除spider没有删除task的问题 2019-09-02 20:49:00 +08:00
陈景阳
6675d075f2 fix 删除spider没有删除task的问题 2019-09-02 20:49:00 +08:00