34 Commits

Author	SHA1	Message	Date
marvzhang	a448c0f06b	fixed unable to sync spiders to nodes error	2020-02-03 16:08:43 +08:00
marvzhang	819e5f56c5	fixed https://github.com/crawlab-team/crawlab/issues/202	2020-02-03 11:08:01 +08:00
陈景阳	81edf9ab72	fix 无法及时同步爬虫的问题	2020-01-28 15:43:57 +08:00
marvzhang	b70949cc87	加入消息通知类型选择	2020-01-15 14:39:51 +08:00
marvzhang	720492ed38	updated setting	2020-01-14 17:29:19 +08:00
marvzhang	875332dba7	更新邮件通知	2020-01-14 11:49:42 +08:00
hantmac	ec9525cb1a	fix	2019-12-24 16:44:54 +08:00
hantmac	893476bd0b	尝试解决节点重复注册问题	2019-12-24 16:11:24 +08:00
陈景阳	761e5257da	Merge remote-tracking branch 'upstream/develop' into develop	2019-12-05 07:15:07 +08:00
marvzhang	3761d906c8	修复爬虫被覆盖的问题	2019-12-04 14:54:49 +08:00
暗音	4f9d8635e5	Merge pull request #13 from crawlab-team/develop ... Develop	2019-11-26 15:29:18 +08:00
marvzhang	dccfb23901	加入储存逻辑	2019-11-25 17:52:19 +08:00
marvzhang	1c32c92c54	refactor code	2019-11-25 16:45:55 +08:00
marvzhang	3f12302cf9	更新可配置爬虫：添加上传GridFS	2019-11-25 13:36:14 +08:00
marvzhang	8b451c8b2b	更新可配置爬虫，修复一些问题	2019-11-24 18:51:32 +08:00
marvzhang	9c282ddb4d	加入可配置爬虫	2019-11-24 17:57:12 +08:00
陈景阳	cb0018ef87	关闭日志打印	2019-11-04 19:58:26 +08:00
陈景阳	9427283e3a	fix 循环依赖的问题	2019-10-28 13:51:12 +08:00
陈景阳	965553b285	fix 代码遗漏	2019-10-28 12:36:00 +08:00
yaziming	ee808e0e60	refactor(all): refactor code ... remove redundant code and some code refactor	2019-10-11 16:01:57 +08:00
陈景阳	41556cab74	fix 删除爬虫的问题	2019-09-30 12:09:37 +08:00
陈景阳	698d240bd6	fix bug	2019-09-26 21:13:25 +08:00
陈景阳	141ec6a000	完成爬虫列表	2019-09-26 20:54:50 +08:00
陈景阳	5f158ddb44	完成爬虫获取	2019-09-26 19:12:02 +08:00
陈景阳	cdeef4b4a5	重构msg的包	2019-09-10 09:32:48 +08:00
yaziming	e10d8fd996	refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions ... detail: 1. add utils.BytesToString function instead of string() convert bytes to string. 2. use bytes.NewReader instead of strings.NewReader(string(sb)). 3. use w.Body.Bytes() instead of []byte(w.Body.String()).	2019-09-03 15:17:32 +08:00
hantmac	cb3d7263b2	bug fix:fix go test ./.. bug	2019-09-03 12:47:18 +08:00
yaziming	a9346a0934	backend: ... 1. Mongo dial add 5 seconds connection timeout. 2. Redis uses connection pool mode. 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.	2019-09-01 17:18:08 +08:00
hantmac	419c667e83	Complete Unit Test for package utils	2019-08-18 19:07:59 +08:00
hantmac	099eb86340	Add Unit Test for backend/utils/chan.go	2019-08-18 14:20:37 +08:00
jonnnh	6cb8a257d9	修改解压缩文件权限默认为0666的问题	2019-08-14 15:35:08 +08:00
Marvin Zhang	023d157f8d	fixed https://github.com/tikazyq/crawlab/issues/114	2019-08-10 16:13:09 +08:00
Marvin Zhang	607ad029dd	added user login/signup	2019-07-26 23:02:30 +08:00
Marvin Zhang	56c99b314f	added golang	2019-07-22 12:51:52 +08:00