28 Commits

Author	SHA1	Message	Date
hantmac	8888e71d1b	fix	2019-12-24 16:44:54 +08:00
hantmac	e16164f63a	尝试解决节点重复注册问题	2019-12-24 16:11:24 +08:00
陈景阳	026c9756b9	Merge remote-tracking branch 'upstream/develop' into develop	2019-12-05 07:15:07 +08:00
marvzhang	97ca3b74b8	修复爬虫被覆盖的问题	2019-12-04 14:54:49 +08:00
暗音	3ef5ddfa07	Merge pull request #13 from crawlab-team/develop ... Develop	2019-11-26 15:29:18 +08:00
marvzhang	825962f8ba	加入储存逻辑	2019-11-25 17:52:19 +08:00
marvzhang	2e5468e4c1	refactor code	2019-11-25 16:45:55 +08:00
marvzhang	178e46dd93	更新可配置爬虫：添加上传GridFS	2019-11-25 13:36:14 +08:00
marvzhang	6a07afa279	更新可配置爬虫，修复一些问题	2019-11-24 18:51:32 +08:00
marvzhang	38d103da39	加入可配置爬虫	2019-11-24 17:57:12 +08:00
陈景阳	1339877b74	关闭日志打印	2019-11-04 19:58:26 +08:00
陈景阳	7a5fd69949	fix 循环依赖的问题	2019-10-28 13:51:12 +08:00
陈景阳	070242c5a2	fix 代码遗漏	2019-10-28 12:36:00 +08:00
yaziming	2f6b517356	refactor(all): refactor code ... remove redundant code and some code refactor	2019-10-11 16:01:57 +08:00
陈景阳	d80642aa0c	fix 删除爬虫的问题	2019-09-30 12:09:37 +08:00
陈景阳	412e0fd983	fix bug	2019-09-26 21:13:25 +08:00
陈景阳	f14085666b	完成爬虫列表	2019-09-26 20:54:50 +08:00
陈景阳	79ee09aacb	完成爬虫获取	2019-09-26 19:12:02 +08:00
陈景阳	9514a8a6af	重构msg的包	2019-09-10 09:32:48 +08:00
yaziming	888a3cab79	refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions ... detail: 1. add utils.BytesToString function instead of string() convert bytes to string. 2. use bytes.NewReader instead of strings.NewReader(string(sb)). 3. use w.Body.Bytes() instead of []byte(w.Body.String()).	2019-09-03 15:17:32 +08:00
hantmac	2ffd1774bf	bug fix:fix go test ./.. bug	2019-09-03 12:47:18 +08:00
yaziming	443d697c6f	backend: ... 1. Mongo dial add 5 seconds connection timeout. 2. Redis uses connection pool mode. 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.	2019-09-01 17:18:08 +08:00
hantmac	0fe20c07f4	Complete Unit Test for package utils	2019-08-18 19:07:59 +08:00
hantmac	98470b87e3	Add Unit Test for backend/utils/chan.go	2019-08-18 14:20:37 +08:00
jonnnh	f4c0726142	修改解压缩文件权限默认为0666的问题	2019-08-14 15:35:08 +08:00
Marvin Zhang	4d73489836	fixed https://github.com/tikazyq/crawlab/issues/114	2019-08-10 16:13:09 +08:00
Marvin Zhang	be9339ff3f	added user login/signup	2019-07-26 23:02:30 +08:00
Marvin Zhang	53cebde962	added golang	2019-07-22 12:51:52 +08:00