marvzhang
3761d906c8
修复爬虫被覆盖的问题
2019-12-04 14:54:49 +08:00
marvzhang
dccfb23901
加入储存逻辑
2019-11-25 17:52:19 +08:00
marvzhang
1c32c92c54
refactor code
2019-11-25 16:45:55 +08:00
marvzhang
3f12302cf9
更新可配置爬虫:添加上传GridFS
2019-11-25 13:36:14 +08:00
marvzhang
8b451c8b2b
更新可配置爬虫,修复一些问题
2019-11-24 18:51:32 +08:00
marvzhang
9c282ddb4d
加入可配置爬虫
2019-11-24 17:57:12 +08:00
yaziming
ee808e0e60
refactor(all): refactor code
...
remove redundant code and some code refactor
2019-10-11 16:01:57 +08:00
陈景阳
41556cab74
fix 删除爬虫的问题
2019-09-30 12:09:37 +08:00
陈景阳
698d240bd6
fix bug
2019-09-26 21:13:25 +08:00
陈景阳
141ec6a000
完成爬虫列表
2019-09-26 20:54:50 +08:00
陈景阳
5f158ddb44
完成爬虫获取
2019-09-26 19:12:02 +08:00
yaziming
a9346a0934
backend:
...
1. Mongo dial add 5 seconds connection timeout.
2. Redis uses connection pool mode.
3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.
2019-09-01 17:18:08 +08:00
jonnnh
6cb8a257d9
修改解压缩文件权限默认为0666的问题
2019-08-14 15:35:08 +08:00
Marvin Zhang
023d157f8d
fixed https://github.com/tikazyq/crawlab/issues/114
2019-08-10 16:13:09 +08:00
Marvin Zhang
56c99b314f
added golang
2019-07-22 12:51:52 +08:00