52 Commits

Author	SHA1	Message	Date
marvzhang	b2dc58a592	updated node offline task update	2020-07-18 21:35:54 +08:00
marvzhang	8a2b7df148	fixed worker node failure issue	2020-07-08 11:36:35 +08:00
marvzhang	ffe9d5f6b6	fixed worker node unable to register issue	2020-07-02 12:07:07 +08:00
marvzhang	c3fedf8247	fixed unable to update node name issue	2020-06-07 12:36:09 +08:00
yaziming	fe9e1f65cf	修复子节点名称显示错误	2020-06-03 18:11:13 +08:00
yaziming	6fac8e6b17	修复子节点不能先注册的问题	2020-06-02 15:32:25 +08:00
yaziming	6687695438	解决节点不存在时，无法主动创建master节点的问题	2020-05-27 19:04:54 +08:00
yaziming	c02c58fd2d	local node	2020-05-26 16:15:05 +08:00
Marvin Zhang	7563bb660c	Merge pull request #741 from yaziming/reactors/simplified-cluster-watcher ... Reactors/simplified	2020-05-24 12:37:17 +08:00
yaziming	22774dd041	增加当前节点本地定时缓存，修改部分潜在BUG，启动时Mongo或者redis无法正常连接时，进入启动等待	2020-05-23 15:15:39 +08:00
yaziming	3d569abd43	GetRedisNode	2020-05-22 15:37:11 +08:00
yaziming	482aaa42eb	simplified	2020-05-22 15:29:14 +08:00
yaziming	a55a9506a1	simplified	2020-05-22 15:24:49 +08:00
marvzhang	73b6f96b6a	修复节点名称	2020-03-08 17:10:13 +08:00
marvzhang	6b39167a8b	加入hostname注册	2020-03-05 08:56:01 +08:00
marvzhang	47fcae9456	updated install-java.sh	2020-03-05 08:09:12 +08:00
暗音	f3c64712c8	Merge branch 'develop' into develop	2020-01-07 00:53:18 +08:00
marvzhang	fa87c419a2	fixed https://github.com/crawlab-team/crawlab/issues/391	2020-01-02 12:51:21 +08:00
marvzhang	8d69de4388	fixed https://github.com/crawlab-team/crawlab/issues/391	2020-01-02 11:16:42 +08:00
陈景阳	4e66f6f3d2	优化UI界面	2020-01-02 10:07:21 +08:00
hantmac	8888e71d1b	fix	2019-12-24 16:44:54 +08:00
hantmac	e16164f63a	尝试解决节点重复注册问题	2019-12-24 16:11:24 +08:00
陈景阳	c64ea5c250	优化代码，添加注释	2019-12-12 20:52:09 +08:00
陈景阳	728dbd5147	fix 同步锁可能异常的情况	2019-12-10 09:22:09 +08:00
陈景阳	b4c160fe22	完成可能重复注册节点的问题	2019-12-09 10:28:48 +08:00
marvzhang	b5c3ca9c32	准备可配置爬虫	2019-11-23 18:13:47 +08:00
暗音	3937cba64f	Merge branch 'develop' into develop	2019-10-28 11:06:13 +08:00
陈景阳	a00fcee801	代码优化	2019-10-15 17:23:03 +08:00
陈景阳	61d32857a7	fix worker无法获取到当前Node的问题	2019-10-12 07:16:11 +08:00
陈景阳	02f744eb96	fix	2019-10-11 22:48:06 +08:00
陈景阳	c00bebbf95	优化节点信息	2019-10-11 21:57:25 +08:00
yaziming	2f6b517356	refactor(all): refactor code ... remove redundant code and some code refactor	2019-10-11 16:01:57 +08:00
陈景阳	c58f213264	添加日志打印	2019-10-10 19:56:04 +08:00
陈景阳	d80642aa0c	fix 删除爬虫的问题	2019-09-30 12:09:37 +08:00
陈景阳	79ee09aacb	完成爬虫获取	2019-09-26 19:12:02 +08:00
陈景阳	fe221ffd6f	fix	2019-09-25 14:38:46 +08:00
陈景阳	9514a8a6af	重构msg的包	2019-09-10 09:32:48 +08:00
yaziming	888a3cab79	refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions ... detail: 1. add utils.BytesToString function instead of string() convert bytes to string. 2. use bytes.NewReader instead of strings.NewReader(string(sb)). 3. use w.Body.Bytes() instead of []byte(w.Body.String()).	2019-09-03 15:17:32 +08:00
yaziming	443d697c6f	backend: ... 1. Mongo dial add 5 seconds connection timeout. 2. Redis uses connection pool mode. 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.	2019-09-01 17:18:08 +08:00
陈景阳	c0201f566a	优化代码	2019-08-31 15:59:43 +08:00
陈景阳	1877677844	fix 无法获取日志的问题	2019-08-31 15:03:57 +08:00
陈景阳	ecaf31f0f0	优化代码	2019-08-31 13:57:14 +08:00
陈景阳	494601ab62	fix 节点注册异常情况	2019-08-31 13:49:34 +08:00
陈景阳	e43332b34f	FIX #178 ... FIX 当日志文件小于2048的时候无法正常拉取日志的问题	2019-08-31 12:42:53 +08:00
陈景阳	0ad2a06d36	添加注释	2019-08-24 15:11:52 +08:00
陈景阳	d913d7c40f	fix TagsView.vue 导致前端报错的问题 ... update 节点注册使用独立的key字段，而不是使用mac字段	2019-08-21 14:37:55 +08:00
陈景阳	f80473a485	添加使用mac地址和ip地址注册的配置项	2019-08-11 20:01:25 +08:00
Marvin Zhang	8c7b597a3b	updated Dockerfile	2019-07-28 15:27:44 +08:00
Marvin Zhang	253c643e8e	added spider stats	2019-07-26 17:07:24 +08:00
Marvin Zhang	fe017b4769	fixed bugs	2019-07-23 12:44:29 +08:00