Commit Graph

839 Commits

Author SHA1 Message Date
陈景阳
494601ab62 fix 节点注册异常情况 2019-08-31 13:49:34 +08:00
陈景阳
e43332b34f FIX #178
FIX 当日志文件小于2048的时候无法正常拉取日志的问题
2019-08-31 12:42:53 +08:00
Marvin Zhang
88d8810b3a Merge pull request #191 from wo10378931/v0.4.0
三个FIX
2019-08-31 12:15:34 +08:00
陈景阳
5af4311b39 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-31 12:09:06 +08:00
陈景阳
c634e2b5cf fix 前端控制台报错的问题 \
fix 无法打印中文的问题
2019-08-31 12:04:12 +08:00
Marvin Zhang
1ba497b8f6 Merge pull request #189 from wo10378931/v0.4.0
两个fix
2019-08-31 11:44:45 +08:00
Marvin Zhang
dcad7bf2ca Merge pull request #190 from hantmac/master
Add delete log files periodically
2019-08-31 11:44:17 +08:00
hantmac
444784d5b6 Add unit test for log.go 2019-08-31 11:30:41 +08:00
hantmac
80b92e1084 Init delete log files periodically 2019-08-31 11:30:01 +08:00
hantmac
a9fc1951c8 Add delete log files periodically 2019-08-31 11:29:24 +08:00
hantmac
95faaa0038 add option for config.yml to config log delete periodically 2019-08-31 11:28:16 +08:00
Marvin Zhang
8633e851a5 Merge pull request #187 from hantmac/master
bug fix: hot fix out of memory problem caused by log read
2019-08-30 18:05:18 +08:00
hantmac
c481c66484 bug fix: hot fix out of memory problem caused by log read 2019-08-30 18:01:22 +08:00
hantmac
0512757166 bug fix: hot fix out of memory problem caused by log read 2019-08-30 17:58:58 +08:00
陈景阳
f098546a65 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-28 16:00:27 +08:00
陈景阳
1736d00161 添加打印日志 2019-08-28 16:00:09 +08:00
Marvin Zhang
03e99d6872 Merge pull request #179 from hantmac/master
bug fix: fix test failed for config.go
2019-08-27 14:24:23 +08:00
hantmac
db81982725 bug fix: fix test failed for config.go 2019-08-27 14:21:39 +08:00
陈景阳
0186d08112 删除爬虫顺带删除文件 2019-08-27 09:39:16 +08:00
Marvin Zhang
2bcd147a60 Merge pull request #176 from yaziming/forked/develop
JSON -> AbortWithStatusJSON
2019-08-27 08:45:49 +08:00
yaziming
b11f31ec18 JSON -> AbortWithStatusJSON 2019-08-26 23:13:26 +08:00
hantmac
9530a3d9b0 add unit test for routes/spider.go 2019-08-26 21:10:55 +08:00
hantmac
f7c0e8310a bug fix:fix permission bug when create spiders dir caused by umask 2019-08-26 17:44:01 +08:00
hantmac
9855d9ef6a hot fix:fix redis lose connection problem 2019-08-26 10:38:40 +08:00
陈景阳
efedf587a4 Merge branch 'master' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-24 17:40:03 +08:00
Marvin Zhang
8a82699f06 Merge pull request #167 from hantmac/develop
remove redundant code
2019-08-24 16:23:28 +08:00
hantmac
366836d0aa remove redundant code 2019-08-24 15:50:53 +08:00
陈景阳
527f33abb4 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-24 15:25:05 +08:00
Marvin Zhang
2981fec602 Merge pull request #166 from hantmac/develop
bug fix: fix redis connection dead cycle
2019-08-24 15:21:59 +08:00
hantmac
f789352ad3 bug fix:fix redis connection dead cycle 2019-08-24 15:16:27 +08:00
陈景阳
0ad2a06d36 添加注释 2019-08-24 15:11:52 +08:00
Marvin Zhang
12016de0f5 Merge pull request #164 from hantmac/develop
Add unit test for task.go
2019-08-24 13:41:04 +08:00
hantmac
ec060a4dc1 Add unit test for task.go 2019-08-24 13:39:06 +08:00
Marvin Zhang
165a1f5d59 Merge pull request #162 from hantmac/develop
unit test for stats.go
2019-08-23 20:52:24 +08:00
hantmac
2a886956da unit test for stats.go 2019-08-23 20:28:11 +08:00
Marvin Zhang
aebd5cf522 Merge pull request #158 from hantmac/develop
modify unit test to use mock
2019-08-22 17:39:19 +08:00
hantmac
03fc2a8e54 modify unit test to use mock 2019-08-22 16:20:30 +08:00
Marvin Zhang
559d317ec5 Merge pull request #154 from wo10378931/master
update 节点注册使用独立的key字段,而不是使用mac字段
2019-08-21 15:09:29 +08:00
陈景阳
221aa33a79 Merge branch 'master' of https://github.com/tikazyq/crawlab 2019-08-21 14:38:46 +08:00
陈景阳
d913d7c40f fix TagsView.vue 导致前端报错的问题
update 节点注册使用独立的key字段,而不是使用mac字段
2019-08-21 14:37:55 +08:00
Marvin Zhang
3b5db8ffa0 Merge pull request #151 from hantmac/develop
Code optimization:change the crawler zip file to slice read
2019-08-20 17:22:32 +08:00
hantmac
21a68693c3 Code optimization:change the crawler zip file to slice read 2019-08-20 17:09:43 +08:00
hantmac
005abc68c8 Code optimization:change the crawler zip file to slice read 2019-08-20 16:59:53 +08:00
Marvin Zhang
b286ec5193 Merge pull request #149 from hantmac/develop
Add unit test for routes/node
2019-08-19 19:06:35 +08:00
hantmac
dcd33910cc Complete unite test for backend/database/mongo.go 2019-08-19 18:48:25 +08:00
hantmac
6ad6a938fa Add unit test for routes/node 2019-08-19 18:06:49 +08:00
Marvin Zhang
8f2d711810 Merge pull request #148 from hantmac/develop
bug fix: fixed mongo.go unit test
2019-08-19 10:15:50 +08:00
hantmac
51707e8f2a bug fix: fixed mongo.go unit test 2019-08-19 09:56:16 +08:00
Marvin Zhang
5fa819a4ee Merge pull request #146 from hantmac/develop
Develop-Complete Unit Test for package utils
2019-08-18 19:46:34 +08:00
Marvin Zhang
cfc3f87903 Merge pull request #145 from wo10378931/master
fix tmp 目录没有提前创建报错的问题
2019-08-18 19:12:53 +08:00