Commit Graph

15 Commits

Author SHA1 Message Date
marvzhang
97ca3b74b8 修复爬虫被覆盖的问题 2019-12-04 14:54:49 +08:00
marvzhang
825962f8ba 加入储存逻辑 2019-11-25 17:52:19 +08:00
marvzhang
2e5468e4c1 refactor code 2019-11-25 16:45:55 +08:00
marvzhang
178e46dd93 更新可配置爬虫:添加上传GridFS 2019-11-25 13:36:14 +08:00
marvzhang
6a07afa279 更新可配置爬虫,修复一些问题 2019-11-24 18:51:32 +08:00
marvzhang
38d103da39 加入可配置爬虫 2019-11-24 17:57:12 +08:00
yaziming
2f6b517356 refactor(all): refactor code
remove redundant code and some code refactor
2019-10-11 16:01:57 +08:00
陈景阳
d80642aa0c fix 删除爬虫的问题 2019-09-30 12:09:37 +08:00
陈景阳
412e0fd983 fix bug 2019-09-26 21:13:25 +08:00
陈景阳
f14085666b 完成爬虫列表 2019-09-26 20:54:50 +08:00
陈景阳
79ee09aacb 完成爬虫获取 2019-09-26 19:12:02 +08:00
yaziming
443d697c6f backend:
1. Mongo dial add 5 seconds connection timeout.
 2. Redis uses connection pool mode.
 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.
2019-09-01 17:18:08 +08:00
jonnnh
f4c0726142 修改解压缩文件权限默认为0666的问题 2019-08-14 15:35:08 +08:00
Marvin Zhang
4d73489836 fixed https://github.com/tikazyq/crawlab/issues/114 2019-08-10 16:13:09 +08:00
Marvin Zhang
53cebde962 added golang 2019-07-22 12:51:52 +08:00