marvzhang
97ca3b74b8
修复爬虫被覆盖的问题
2019-12-04 14:54:49 +08:00
marvzhang
825962f8ba
加入储存逻辑
2019-11-25 17:52:19 +08:00
marvzhang
2e5468e4c1
refactor code
2019-11-25 16:45:55 +08:00
marvzhang
178e46dd93
更新可配置爬虫:添加上传GridFS
2019-11-25 13:36:14 +08:00
marvzhang
6a07afa279
更新可配置爬虫,修复一些问题
2019-11-24 18:51:32 +08:00
marvzhang
38d103da39
加入可配置爬虫
2019-11-24 17:57:12 +08:00
yaziming
2f6b517356
refactor(all): refactor code
...
remove redundant code and some code refactor
2019-10-11 16:01:57 +08:00
陈景阳
d80642aa0c
fix 删除爬虫的问题
2019-09-30 12:09:37 +08:00
陈景阳
412e0fd983
fix bug
2019-09-26 21:13:25 +08:00
陈景阳
f14085666b
完成爬虫列表
2019-09-26 20:54:50 +08:00
陈景阳
79ee09aacb
完成爬虫获取
2019-09-26 19:12:02 +08:00
yaziming
443d697c6f
backend:
...
1. Mongo dial add 5 seconds connection timeout.
2. Redis uses connection pool mode.
3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.
2019-09-01 17:18:08 +08:00
jonnnh
f4c0726142
修改解压缩文件权限默认为0666的问题
2019-08-14 15:35:08 +08:00
Marvin Zhang
4d73489836
fixed https://github.com/tikazyq/crawlab/issues/114
2019-08-10 16:13:09 +08:00
Marvin Zhang
53cebde962
added golang
2019-07-22 12:51:52 +08:00