Commit Graph

35 Commits

Author SHA1 Message Date
Marvin Zhang
53614ba168 Merge pull request #741 from yaziming/reactors/simplified-cluster-watcher
Reactors/simplified
2020-05-24 12:37:17 +08:00
yaziming
ff9c9d57ef 增加当前节点本地定时缓存,修改部分潜在BUG,启动时Mongo或者redis无法正常连接时,进入启动等待 2020-05-23 15:15:39 +08:00
yaziming
e2c876865b simplified 2020-05-22 15:24:49 +08:00
Marvin Zhang
b5c111bf28 Merge pull request #723 from bestgopher/optimization
一点小优化
2020-05-08 16:32:30 +08:00
bestgopher
f881058687 一点小优化 2020-05-08 15:29:07 +08:00
hantmac
a9ae673d52 support send log to ES 2020-04-27 15:59:06 +08:00
marvzhang
633740f1c2 fixed https://github.com/crawlab-team/crawlab/issues/485 2020-02-01 19:18:30 +08:00
marvzhang
4b5c649eca fixed "nil returned" error 2020-01-11 16:44:53 +08:00
hantmac
c88c3abf85 Add Unique index for 'key' 2020-01-04 17:29:05 +08:00
marvzhang
98cc4646a3 优化依赖安装 2020-01-03 10:54:20 +08:00
marvzhang
53c77eb6e9 加入卸载依赖逻辑 2020-01-02 17:38:39 +08:00
marvzhang
836dc12703 加入RPC机制,完成部分依赖安装逻辑 2020-01-02 15:53:53 +08:00
yaziming
086d50f512 fix(backend):
修复redis连接池订阅消息失败时,因为ping操作优先获取到错误造成chain提前关闭引发panic的问题
2019-12-25 14:02:45 +08:00
marvzhang
234db7196c fixed https://github.com/crawlab-team/crawlab/issues/373 2019-12-19 10:42:20 +08:00
陈景阳
c071a93c5b fix 同步锁可能异常的情况 2019-12-10 09:22:09 +08:00
陈景阳
280877a0ae 完成可能重复注册节点的问题 2019-12-09 10:28:48 +08:00
韩山杰
d4525116ea modity redis DialWriteTimeout to 15s 2019-11-22 22:29:02 +08:00
yaziming
ee808e0e60 refactor(all): refactor code
remove redundant code and some code refactor
2019-10-11 16:01:57 +08:00
yaziming
329b4a6470 fix(backend): fix mongo connect error when password has special characters 2019-10-01 09:58:24 +08:00
陈景阳
fda7e56e1a 添加日志打印 2019-09-25 16:19:58 +08:00
陈景阳
42e7647cd4 fix 消息无法订阅问题
fix 可能出现重复爬虫的问题
2019-09-10 14:26:50 +08:00
yaziming
361134f8dd Remove redundant fmt.Println 2019-09-02 22:57:29 +08:00
yaziming
10c3488caf break loop when subscribe count is 0 2019-09-02 18:32:47 +08:00
yaziming
a9346a0934 backend:
1. Mongo dial add 5 seconds connection timeout.
 2. Redis uses connection pool mode.
 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.
2019-09-01 17:18:08 +08:00
hantmac
1507e6724b hot fix:fix redis lose connection problem 2019-08-26 10:38:40 +08:00
hantmac
561a9d260b remove redundant code 2019-08-24 15:50:53 +08:00
hantmac
3f249c8c61 bug fix:fix redis connection dead cycle 2019-08-24 15:16:27 +08:00
hantmac
be9def35dc Complete unite test for backend/database/mongo.go 2019-08-19 18:48:25 +08:00
hantmac
3fa7b535f4 bug fix: fixed mongo.go unit test 2019-08-19 09:56:16 +08:00
hantmac
15e7fa662e Add Some Unit Test 2019-08-18 12:09:54 +08:00
陈景阳
fcdfe9bc4f FIX MongoDB 连接问题 2019-08-01 14:39:35 +08:00
陈景阳
1f5e95b6a5 fix mongodb 在有账号密码情况下连接错误的问题 2019-08-01 14:08:13 +08:00
陈景阳
4f5352fc57 fix redis连接问题 2019-07-31 14:35:36 +08:00
Marvin Zhang
bf387354e0 added mongodb username / password support 2019-07-29 22:09:15 +08:00
Marvin Zhang
56c99b314f added golang 2019-07-22 12:51:52 +08:00