91 Commits

Author	SHA1	Message	Date
陈景阳	8115f06496	优化代码	2019-08-31 15:59:43 +08:00
陈景阳	5e6aec2393	fix 无法获取日志的问题	2019-08-31 15:03:57 +08:00
陈景阳	b61445acb0	优化代码	2019-08-31 13:57:14 +08:00
陈景阳	4944883f95	fix 节点注册异常情况	2019-08-31 13:49:34 +08:00
陈景阳	57dddc84ed	FIX #178 ... FIX 当日志文件小于2048的时候无法正常拉取日志的问题	2019-08-31 12:42:53 +08:00
陈景阳	53ab5b6016	Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0	2019-08-31 12:09:06 +08:00
陈景阳	771cb76277	fix 前端控制台报错的问题 \ ... fix 无法打印中文的问题	2019-08-31 12:04:12 +08:00
Marvin Zhang	14409d5869	Merge pull request #189 from wo10378931/v0.4.0 ... 两个fix	2019-08-31 11:44:45 +08:00
Marvin Zhang	c0cb6fd3e1	Merge pull request #190 from hantmac/master ... Add delete log files periodically	2019-08-31 11:44:17 +08:00
hantmac	39a2a3d635	Add unit test for log.go	2019-08-31 11:30:41 +08:00
hantmac	f4a5dfa503	Init delete log files periodically	2019-08-31 11:30:01 +08:00
hantmac	5720f3f277	Add delete log files periodically	2019-08-31 11:29:24 +08:00
hantmac	8b50e12681	add option for config.yml to config log delete periodically	2019-08-31 11:28:16 +08:00
Marvin Zhang	ab554fa297	Merge pull request #187 from hantmac/master ... bug fix: hot fix out of memory problem caused by log read	2019-08-30 18:05:18 +08:00
hantmac	782e5694e6	bug fix: hot fix out of memory problem caused by log read	2019-08-30 18:01:22 +08:00
hantmac	1b29a27ab0	bug fix: hot fix out of memory problem caused by log read	2019-08-30 17:58:58 +08:00
陈景阳	d5dce56712	Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0	2019-08-28 16:00:27 +08:00
陈景阳	cae11e3796	添加打印日志	2019-08-28 16:00:09 +08:00
Marvin Zhang	8efc90353e	Merge pull request #179 from hantmac/master ... bug fix: fix test failed for config.go	2019-08-27 14:24:23 +08:00
hantmac	36eaad64a5	bug fix: fix test failed for config.go	2019-08-27 14:21:39 +08:00
陈景阳	c7e137a6aa	删除爬虫顺带删除文件	2019-08-27 09:39:16 +08:00
Marvin Zhang	9bd7c6670f	Merge pull request #176 from yaziming/forked/develop ... JSON -> AbortWithStatusJSON	2019-08-27 08:45:49 +08:00
yaziming	ba0471355b	JSON -> AbortWithStatusJSON	2019-08-26 23:13:26 +08:00
hantmac	5e707adad4	add unit test for routes/spider.go	2019-08-26 21:10:55 +08:00
hantmac	007f10b83b	bug fix:fix permission bug when create spiders dir caused by umask	2019-08-26 17:44:01 +08:00
hantmac	1507e6724b	hot fix:fix redis lose connection problem	2019-08-26 10:38:40 +08:00
陈景阳	faac001663	Merge branch 'master' of https://github.com/crawlab-team/crawlab into v0.4.0	2019-08-24 17:40:03 +08:00
Marvin Zhang	275206f61b	Merge pull request #167 from hantmac/develop ... remove redundant code	2019-08-24 16:23:28 +08:00
hantmac	561a9d260b	remove redundant code	2019-08-24 15:50:53 +08:00
陈景阳	df46156305	Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0	2019-08-24 15:25:05 +08:00
Marvin Zhang	5bb727e808	Merge pull request #166 from hantmac/develop ... bug fix: fix redis connection dead cycle	2019-08-24 15:21:59 +08:00
hantmac	3f249c8c61	bug fix:fix redis connection dead cycle	2019-08-24 15:16:27 +08:00
陈景阳	ce8fb86700	添加注释	2019-08-24 15:11:52 +08:00
Marvin Zhang	dcaf2ae2db	Merge pull request #164 from hantmac/develop ... Add unit test for task.go	2019-08-24 13:41:04 +08:00
hantmac	2c0ac66cb1	Add unit test for task.go	2019-08-24 13:39:06 +08:00
Marvin Zhang	c772e801ce	Merge pull request #162 from hantmac/develop ... unit test for stats.go	2019-08-23 20:52:24 +08:00
hantmac	44e98a56a3	unit test for stats.go	2019-08-23 20:28:11 +08:00
Marvin Zhang	00a61ed7dc	Merge pull request #158 from hantmac/develop ... modify unit test to use mock	2019-08-22 17:39:19 +08:00
hantmac	87f1cebc3b	modify unit test to use mock	2019-08-22 16:20:30 +08:00
Marvin Zhang	a7bb03e5eb	Merge pull request #154 from wo10378931/master ... update 节点注册使用独立的key字段，而不是使用mac字段	2019-08-21 15:09:29 +08:00
陈景阳	1417b5c0c4	Merge branch 'master' of https://github.com/tikazyq/crawlab	2019-08-21 14:38:46 +08:00
陈景阳	3643895f04	fix TagsView.vue 导致前端报错的问题 ... update 节点注册使用独立的key字段，而不是使用mac字段	2019-08-21 14:37:55 +08:00
Marvin Zhang	610f6bb2ed	Merge pull request #151 from hantmac/develop ... Code optimization:change the crawler zip file to slice read	2019-08-20 17:22:32 +08:00
hantmac	4446f8704a	Code optimization:change the crawler zip file to slice read	2019-08-20 17:09:43 +08:00
hantmac	a599db1810	Code optimization:change the crawler zip file to slice read	2019-08-20 16:59:53 +08:00
Marvin Zhang	067dba6cfb	Merge pull request #149 from hantmac/develop ... Add unit test for routes/node	2019-08-19 19:06:35 +08:00
hantmac	be9def35dc	Complete unite test for backend/database/mongo.go	2019-08-19 18:48:25 +08:00
hantmac	22c599c9dd	Add unit test for routes/node	2019-08-19 18:06:49 +08:00
Marvin Zhang	398f7f242c	Merge pull request #148 from hantmac/develop ... bug fix: fixed mongo.go unit test	2019-08-19 10:15:50 +08:00
hantmac	3fa7b535f4	bug fix: fixed mongo.go unit test	2019-08-19 09:56:16 +08:00