52 Commits

Author	SHA1	Message	Date
marvzhang	1fbed2679d	updated node offline task update	2020-07-18 21:35:54 +08:00
marvzhang	f09d9b3e6e	fixed worker node failure issue	2020-07-08 11:36:35 +08:00
marvzhang	14ab3b9208	fixed worker node unable to register issue	2020-07-02 12:07:07 +08:00
marvzhang	02125c2fa2	fixed unable to update node name issue	2020-06-07 12:36:09 +08:00
yaziming	5f14014f67	修复子节点名称显示错误	2020-06-03 18:11:13 +08:00
yaziming	eed50ba38f	修复子节点不能先注册的问题	2020-06-02 15:32:25 +08:00
yaziming	93c06d0464	解决节点不存在时，无法主动创建master节点的问题	2020-05-27 19:04:54 +08:00
yaziming	53b30e5676	local node	2020-05-26 16:15:05 +08:00
Marvin Zhang	53614ba168	Merge pull request #741 from yaziming/reactors/simplified-cluster-watcher ... Reactors/simplified	2020-05-24 12:37:17 +08:00
yaziming	ff9c9d57ef	增加当前节点本地定时缓存，修改部分潜在BUG，启动时Mongo或者redis无法正常连接时，进入启动等待	2020-05-23 15:15:39 +08:00
yaziming	77b950f34f	GetRedisNode	2020-05-22 15:37:11 +08:00
yaziming	92a69b219b	simplified	2020-05-22 15:29:14 +08:00
yaziming	e2c876865b	simplified	2020-05-22 15:24:49 +08:00
marvzhang	cc81b80397	修复节点名称	2020-03-08 17:10:13 +08:00
marvzhang	a3326da0f5	加入hostname注册	2020-03-05 08:56:01 +08:00
marvzhang	9e24d22ee1	updated install-java.sh	2020-03-05 08:09:12 +08:00
暗音	081f8adc2b	Merge branch 'develop' into develop	2020-01-07 00:53:18 +08:00
marvzhang	af93733bc5	fixed https://github.com/crawlab-team/crawlab/issues/391	2020-01-02 12:51:21 +08:00
marvzhang	857bcdba16	fixed https://github.com/crawlab-team/crawlab/issues/391	2020-01-02 11:16:42 +08:00
陈景阳	52a8fce894	优化UI界面	2020-01-02 10:07:21 +08:00
hantmac	ec9525cb1a	fix	2019-12-24 16:44:54 +08:00
hantmac	893476bd0b	尝试解决节点重复注册问题	2019-12-24 16:11:24 +08:00
陈景阳	d8061dbf8f	优化代码，添加注释	2019-12-12 20:52:09 +08:00
陈景阳	c071a93c5b	fix 同步锁可能异常的情况	2019-12-10 09:22:09 +08:00
陈景阳	280877a0ae	完成可能重复注册节点的问题	2019-12-09 10:28:48 +08:00
marvzhang	607ce70f5c	准备可配置爬虫	2019-11-23 18:13:47 +08:00
暗音	bcf3978600	Merge branch 'develop' into develop	2019-10-28 11:06:13 +08:00
陈景阳	d4c152f93a	代码优化	2019-10-15 17:23:03 +08:00
陈景阳	6af06efc17	fix worker无法获取到当前Node的问题	2019-10-12 07:16:11 +08:00
陈景阳	7dae91ab50	fix	2019-10-11 22:48:06 +08:00
陈景阳	973251a0fb	优化节点信息	2019-10-11 21:57:25 +08:00
yaziming	ee808e0e60	refactor(all): refactor code ... remove redundant code and some code refactor	2019-10-11 16:01:57 +08:00
陈景阳	46d89c8cce	添加日志打印	2019-10-10 19:56:04 +08:00
陈景阳	41556cab74	fix 删除爬虫的问题	2019-09-30 12:09:37 +08:00
陈景阳	5f158ddb44	完成爬虫获取	2019-09-26 19:12:02 +08:00
陈景阳	951f6a9f07	fix	2019-09-25 14:38:46 +08:00
陈景阳	cdeef4b4a5	重构msg的包	2019-09-10 09:32:48 +08:00
yaziming	e10d8fd996	refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions ... detail: 1. add utils.BytesToString function instead of string() convert bytes to string. 2. use bytes.NewReader instead of strings.NewReader(string(sb)). 3. use w.Body.Bytes() instead of []byte(w.Body.String()).	2019-09-03 15:17:32 +08:00
yaziming	a9346a0934	backend: ... 1. Mongo dial add 5 seconds connection timeout. 2. Redis uses connection pool mode. 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.	2019-09-01 17:18:08 +08:00
陈景阳	8115f06496	优化代码	2019-08-31 15:59:43 +08:00
陈景阳	5e6aec2393	fix 无法获取日志的问题	2019-08-31 15:03:57 +08:00
陈景阳	b61445acb0	优化代码	2019-08-31 13:57:14 +08:00
陈景阳	4944883f95	fix 节点注册异常情况	2019-08-31 13:49:34 +08:00
陈景阳	57dddc84ed	FIX #178 ... FIX 当日志文件小于2048的时候无法正常拉取日志的问题	2019-08-31 12:42:53 +08:00
陈景阳	ce8fb86700	添加注释	2019-08-24 15:11:52 +08:00
陈景阳	3643895f04	fix TagsView.vue 导致前端报错的问题 ... update 节点注册使用独立的key字段，而不是使用mac字段	2019-08-21 14:37:55 +08:00
陈景阳	aff161ffd3	添加使用mac地址和ip地址注册的配置项	2019-08-11 20:01:25 +08:00
Marvin Zhang	f3e78423f8	updated Dockerfile	2019-07-28 15:27:44 +08:00
Marvin Zhang	946bb7ceba	added spider stats	2019-07-26 17:07:24 +08:00
Marvin Zhang	55f8ffa05f	fixed bugs	2019-07-23 12:44:29 +08:00