26 Commits

Author	SHA1	Message	Date
陈景阳	c58f213264	添加日志打印	2019-10-10 19:56:04 +08:00
陈景阳	efd742f55d	修改版本号	2019-10-08 20:26:08 +08:00
陈景阳	45c2f85856	fix 状态的问题	2019-10-08 20:20:48 +08:00
陈景阳	86e33fc43a	fix 状态的问题	2019-10-08 20:16:49 +08:00
陈景阳	80c70ec8ae	fix 状态错误的问题	2019-10-08 19:41:29 +08:00
陈景阳	d80642aa0c	fix 删除爬虫的问题	2019-09-30 12:09:37 +08:00
陈景阳	79ee09aacb	完成爬虫获取	2019-09-26 19:12:02 +08:00
陈景阳	d27f3c04d6	fix 可能直接退出的问题	2019-09-26 16:49:01 +08:00
陈景阳	9237e62a48	爬虫逻辑修改为从GridFS获取	2019-09-26 11:28:20 +08:00
陈景阳	c37c0b963b	fix 无法终止任务的问题	2019-09-26 10:29:58 +08:00
陈景阳	cde06a0000	fix 无法终止任务的问题	2019-09-26 10:23:08 +08:00
陈景阳	52b7577e0e	添加日志打印	2019-09-26 09:37:10 +08:00
陈景阳	48dcf5a952	添加日志打印	2019-09-25 16:19:58 +08:00
陈景阳	613b5eb139	fix 无法获取task的错误	2019-09-25 15:11:27 +08:00
陈景阳	fe221ffd6f	fix	2019-09-25 14:38:46 +08:00
陈景阳	9514a8a6af	重构msg的包	2019-09-10 09:32:48 +08:00
Marvin Zhang	3eee129a7c	added param to task	2019-09-04 20:13:12 +08:00
hantmac	fb58cc1a28	bug fix:fix data race caused by LockList	2019-09-04 13:51:02 +08:00
yaziming	888a3cab79	refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions ... detail: 1. add utils.BytesToString function instead of string() convert bytes to string. 2. use bytes.NewReader instead of strings.NewReader(string(sb)). 3. use w.Body.Bytes() instead of []byte(w.Body.String()).	2019-09-03 15:17:32 +08:00
yaziming	443d697c6f	backend: ... 1. Mongo dial add 5 seconds connection timeout. 2. Redis uses connection pool mode. 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.	2019-09-01 17:18:08 +08:00
陈景阳	1a383dac17	fix 爬虫目录无法打开的问题	2019-08-31 17:04:49 +08:00
陈景阳	0186d08112	删除爬虫顺带删除文件	2019-08-27 09:39:16 +08:00
Marvin Zhang	b6d3d139a3	fixed upload bug	2019-07-29 20:31:44 +08:00
Marvin Zhang	8c7b597a3b	updated Dockerfile	2019-07-28 15:27:44 +08:00
Marvin Zhang	253c643e8e	added spider stats	2019-07-26 17:07:24 +08:00
Marvin Zhang	53cebde962	added golang	2019-07-22 12:51:52 +08:00