28 Commits

Author	SHA1	Message	Date
hantmac	ec9525cb1a	fix	2019-12-24 16:44:54 +08:00
hantmac	893476bd0b	尝试解决节点重复注册问题	2019-12-24 16:11:24 +08:00
陈景阳	761e5257da	Merge remote-tracking branch 'upstream/develop' into develop	2019-12-05 07:15:07 +08:00
marvzhang	3761d906c8	修复爬虫被覆盖的问题	2019-12-04 14:54:49 +08:00
暗音	4f9d8635e5	Merge pull request #13 from crawlab-team/develop ... Develop	2019-11-26 15:29:18 +08:00
marvzhang	dccfb23901	加入储存逻辑	2019-11-25 17:52:19 +08:00
marvzhang	1c32c92c54	refactor code	2019-11-25 16:45:55 +08:00
marvzhang	3f12302cf9	更新可配置爬虫：添加上传GridFS	2019-11-25 13:36:14 +08:00
marvzhang	8b451c8b2b	更新可配置爬虫，修复一些问题	2019-11-24 18:51:32 +08:00
marvzhang	9c282ddb4d	加入可配置爬虫	2019-11-24 17:57:12 +08:00
陈景阳	cb0018ef87	关闭日志打印	2019-11-04 19:58:26 +08:00
陈景阳	9427283e3a	fix 循环依赖的问题	2019-10-28 13:51:12 +08:00
陈景阳	965553b285	fix 代码遗漏	2019-10-28 12:36:00 +08:00
yaziming	ee808e0e60	refactor(all): refactor code ... remove redundant code and some code refactor	2019-10-11 16:01:57 +08:00
陈景阳	41556cab74	fix 删除爬虫的问题	2019-09-30 12:09:37 +08:00
陈景阳	698d240bd6	fix bug	2019-09-26 21:13:25 +08:00
陈景阳	141ec6a000	完成爬虫列表	2019-09-26 20:54:50 +08:00
陈景阳	5f158ddb44	完成爬虫获取	2019-09-26 19:12:02 +08:00
陈景阳	cdeef4b4a5	重构msg的包	2019-09-10 09:32:48 +08:00
yaziming	e10d8fd996	refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions ... detail: 1. add utils.BytesToString function instead of string() convert bytes to string. 2. use bytes.NewReader instead of strings.NewReader(string(sb)). 3. use w.Body.Bytes() instead of []byte(w.Body.String()).	2019-09-03 15:17:32 +08:00
hantmac	cb3d7263b2	bug fix:fix go test ./.. bug	2019-09-03 12:47:18 +08:00
yaziming	a9346a0934	backend: ... 1. Mongo dial add 5 seconds connection timeout. 2. Redis uses connection pool mode. 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.	2019-09-01 17:18:08 +08:00
hantmac	419c667e83	Complete Unit Test for package utils	2019-08-18 19:07:59 +08:00
hantmac	099eb86340	Add Unit Test for backend/utils/chan.go	2019-08-18 14:20:37 +08:00
jonnnh	6cb8a257d9	修改解压缩文件权限默认为0666的问题	2019-08-14 15:35:08 +08:00
Marvin Zhang	023d157f8d	fixed https://github.com/tikazyq/crawlab/issues/114	2019-08-10 16:13:09 +08:00
Marvin Zhang	607ad029dd	added user login/signup	2019-07-26 23:02:30 +08:00
Marvin Zhang	56c99b314f	added golang	2019-07-22 12:51:52 +08:00