Commit Graph

14 Commits

Author SHA1 Message Date
陈景阳
48dcf5a952 添加日志打印 2019-09-25 16:19:58 +08:00
陈景阳
613b5eb139 fix 无法获取task的错误 2019-09-25 15:11:27 +08:00
陈景阳
fe221ffd6f fix 2019-09-25 14:38:46 +08:00
陈景阳
9514a8a6af 重构msg的包 2019-09-10 09:32:48 +08:00
Marvin Zhang
3eee129a7c added param to task 2019-09-04 20:13:12 +08:00
hantmac
fb58cc1a28 bug fix:fix data race caused by LockList 2019-09-04 13:51:02 +08:00
yaziming
888a3cab79 refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
detail:
    1. add utils.BytesToString function instead of string() convert bytes to string.
    2. use bytes.NewReader instead of strings.NewReader(string(sb)).
    3. use w.Body.Bytes() instead of []byte(w.Body.String()).
2019-09-03 15:17:32 +08:00
yaziming
443d697c6f backend:
1. Mongo dial add 5 seconds connection timeout.
 2. Redis uses connection pool mode.
 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.
2019-09-01 17:18:08 +08:00
陈景阳
1a383dac17 fix 爬虫目录无法打开的问题 2019-08-31 17:04:49 +08:00
陈景阳
0186d08112 删除爬虫顺带删除文件 2019-08-27 09:39:16 +08:00
Marvin Zhang
b6d3d139a3 fixed upload bug 2019-07-29 20:31:44 +08:00
Marvin Zhang
8c7b597a3b updated Dockerfile 2019-07-28 15:27:44 +08:00
Marvin Zhang
253c643e8e added spider stats 2019-07-26 17:07:24 +08:00
Marvin Zhang
53cebde962 added golang 2019-07-22 12:51:52 +08:00