18 Commits

Author	SHA1	Message	Date
marvzhang	d9880a2687	fixed http://localhost:8080/#/spiders/5e7ea8fbec047d0a2ebfcc3b	2020-03-28 12:33:20 +08:00
marvzhang	a448c0f06b	fixed unable to sync spiders to nodes error	2020-02-03 16:08:43 +08:00
陈景阳	81edf9ab72	fix 无法及时同步爬虫的问题	2020-01-28 15:43:57 +08:00
marvzhang	3761d906c8	修复爬虫被覆盖的问题	2019-12-04 14:54:49 +08:00
marvzhang	dccfb23901	加入储存逻辑	2019-11-25 17:52:19 +08:00
marvzhang	1c32c92c54	refactor code	2019-11-25 16:45:55 +08:00
marvzhang	3f12302cf9	更新可配置爬虫：添加上传GridFS	2019-11-25 13:36:14 +08:00
marvzhang	8b451c8b2b	更新可配置爬虫，修复一些问题	2019-11-24 18:51:32 +08:00
marvzhang	9c282ddb4d	加入可配置爬虫	2019-11-24 17:57:12 +08:00
yaziming	ee808e0e60	refactor(all): refactor code ... remove redundant code and some code refactor	2019-10-11 16:01:57 +08:00
陈景阳	41556cab74	fix 删除爬虫的问题	2019-09-30 12:09:37 +08:00
陈景阳	698d240bd6	fix bug	2019-09-26 21:13:25 +08:00
陈景阳	141ec6a000	完成爬虫列表	2019-09-26 20:54:50 +08:00
陈景阳	5f158ddb44	完成爬虫获取	2019-09-26 19:12:02 +08:00
yaziming	a9346a0934	backend: ... 1. Mongo dial add 5 seconds connection timeout. 2. Redis uses connection pool mode. 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.	2019-09-01 17:18:08 +08:00
jonnnh	6cb8a257d9	修改解压缩文件权限默认为0666的问题	2019-08-14 15:35:08 +08:00
Marvin Zhang	023d157f8d	fixed https://github.com/tikazyq/crawlab/issues/114	2019-08-10 16:13:09 +08:00
Marvin Zhang	56c99b314f	added golang	2019-07-22 12:51:52 +08:00