git-sync/crawlab
1
0
Fork 0
mirror of https://github.com/crawlab-team/crawlab.git synced 2026-01-22 17:31:03 +01:00
Code Issues Packages Projects Releases Wiki Activity
756 Commits 6 Branches 35 Tags
cb3d7263b2ec3844a5e729efffa10d227fbbc460
Commit Graph

44 Commits

Author SHA1 Message Date
陈景阳
cd78e6c745 还原代码 2019-09-03 09:06:04 +08:00
陈景阳
eb92d34f9b Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop 2019-09-03 08:57:21 +08:00
陈景阳
b5084c964b 还原代码 2019-09-02 18:14:34 +08:00
陈景阳
8b237ddc2a fix 无法正常删除有问题的爬虫 2019-09-02 18:04:47 +08:00
陈景阳
93dd3b714a fix 如果从dir读取爬虫为空，则移除所有的爬虫 2019-09-02 17:37:48 +08:00
陈景阳
f9fdf5b8d8 fix 打印日志只有2KB 2019-09-02 16:45:56 +08:00
yaziming
a9346a0934 backend: 
1. Mongo dial add 5 seconds connection timeout.
 2. Redis uses connection pool mode.
 3. Redis pool new connection have 10 seconds write timeout and read timeout and connection timeout.
 2019-09-01 17:18:08 +08:00
Jeremy
92c37a9e5c Merge branch 'develop' into master 2019-09-01 00:13:19 +08:00
hantmac
1de80f7779 add unit test for GetLocalLog 2019-09-01 00:07:18 +08:00
hantmac
b766be577a bug fix:fix read log file oom 2019-09-01 00:06:26 +08:00
yaziming
81f6cf021f Backend: 
improve
     - AuthMiddleware 注入当前用户的信息
     - 增加Context服务支持快捷获取当前登录者信息
     - 重构Login/GetMe接口逻辑避免重复的数据库查询
     - 规范化error信息声明(向下兼容,旧代码可逐渐迁移规范化)
     - 修正部分不符合规范的代码
 2019-08-31 21:26:56 +08:00
陈景阳
b9ed176950 添加日志打印 2019-08-31 17:56:42 +08:00
陈景阳
e423ff564c fix 爬虫目录无法打开的问题 2019-08-31 17:04:49 +08:00
陈景阳
8115f06496 优化代码 2019-08-31 15:59:43 +08:00
陈景阳
5e6aec2393 fix 无法获取日志的问题 2019-08-31 15:03:57 +08:00
陈景阳
b61445acb0 优化代码 2019-08-31 13:57:14 +08:00
陈景阳
4944883f95 fix 节点注册异常情况 2019-08-31 13:49:34 +08:00
陈景阳
57dddc84ed FIX #178 
FIX 当日志文件小于2048的时候无法正常拉取日志的问题
 2019-08-31 12:42:53 +08:00
陈景阳
53ab5b6016 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-31 12:09:06 +08:00
陈景阳
771cb76277 fix 前端控制台报错的问题 \ 
fix 无法打印中文的问题
 2019-08-31 12:04:12 +08:00
Marvin Zhang
14409d5869 Merge pull request #189 from wo10378931/v0.4.0 
两个fix
 2019-08-31 11:44:45 +08:00
hantmac
39a2a3d635 Add unit test for log.go 2019-08-31 11:30:41 +08:00
hantmac
5720f3f277 Add delete log files periodically 2019-08-31 11:29:24 +08:00
hantmac
782e5694e6 bug fix: hot fix out of memory problem caused by log read 2019-08-30 18:01:22 +08:00
hantmac
1b29a27ab0 bug fix: hot fix out of memory problem caused by log read 2019-08-30 17:58:58 +08:00
陈景阳
d5dce56712 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-28 16:00:27 +08:00
陈景阳
cae11e3796 添加打印日志 2019-08-28 16:00:09 +08:00
陈景阳
c7e137a6aa 删除爬虫顺带删除文件 2019-08-27 09:39:16 +08:00
hantmac
007f10b83b bug fix:fix permission bug when create spiders dir caused by umask 2019-08-26 17:44:01 +08:00
陈景阳
ce8fb86700 添加注释 2019-08-24 15:11:52 +08:00
Marvin Zhang
a7bb03e5eb Merge pull request #154 from wo10378931/master 
update 节点注册使用独立的key字段，而不是使用mac字段
 2019-08-21 15:09:29 +08:00
陈景阳
3643895f04 fix TagsView.vue 导致前端报错的问题 
update 节点注册使用独立的key字段，而不是使用mac字段
 2019-08-21 14:37:55 +08:00
hantmac
4446f8704a Code optimization:change the crawler zip file to slice read 2019-08-20 17:09:43 +08:00
hantmac
a599db1810 Code optimization:change the crawler zip file to slice read 2019-08-20 16:59:53 +08:00
陈景阳
aff161ffd3 添加使用mac地址和ip地址注册的配置项 2019-08-11 20:01:25 +08:00
Marvin Zhang
83babba43f fixed upload bug 2019-07-29 20:31:44 +08:00
Marvin Zhang
f3e78423f8 updated Dockerfile 2019-07-28 15:27:44 +08:00
Marvin Zhang
0c8aa3c43b added jwt 2019-07-27 00:00:59 +08:00
Marvin Zhang
607ad029dd added user login/signup 2019-07-26 23:02:30 +08:00
Marvin Zhang
946bb7ceba added spider stats 2019-07-26 17:07:24 +08:00
Marvin Zhang
55f8ffa05f fixed bugs 2019-07-23 12:44:29 +08:00
Marvin Zhang
1e0449e415 fetch sysinfo from remote 2019-07-22 22:25:29 +08:00
Marvin Zhang
9f5664084a added sysinfo 2019-07-22 13:33:09 +08:00
Marvin Zhang
56c99b314f added golang 2019-07-22 12:51:52 +08:00