陈景阳
05136b0fac
fix 定时任务参数错误的问题
2019-10-16 15:27:12 +08:00
陈景阳
cd7f6e66b4
fix 定时任务管理
2019-10-11 23:53:07 +08:00
陈景阳
02f744eb96
fix
2019-10-11 22:48:06 +08:00
陈景阳
c00bebbf95
优化节点信息
2019-10-11 21:57:25 +08:00
陈景阳
0d10d6d045
fix 创建目录错误的问题
2019-10-07 12:21:32 +08:00
陈景阳
8294e7cb4b
完成爬虫的分类
2019-09-30 16:35:36 +08:00
陈景阳
ffd5725f3b
添加爬虫类型
2019-09-30 14:43:48 +08:00
陈景阳
d80642aa0c
fix 删除爬虫的问题
2019-09-30 12:09:37 +08:00
陈景阳
424e2a5e14
fix 重复获取爬虫的问题
2019-09-27 12:07:38 +08:00
陈景阳
7b93d8a67b
fix 上传爬虫名称错误的问题
2019-09-27 11:30:38 +08:00
陈景阳
41e9edf940
完成爬虫列表
2019-09-26 20:53:05 +08:00
陈景阳
5416b7ac60
fix 上传的问题
2019-09-26 19:44:12 +08:00
陈景阳
6df6155daf
优化爬虫获取逻辑
2019-09-26 16:26:32 +08:00
陈景阳
475bf4c69e
优化爬虫获取逻辑
2019-09-26 11:38:13 +08:00
陈景阳
9237e62a48
爬虫逻辑修改为从GridFS获取
2019-09-26 11:28:20 +08:00
陈景阳
27f36cf91f
删除日志
2019-09-10 09:51:27 +08:00
陈景阳
9514a8a6af
重构msg的包
2019-09-10 09:32:48 +08:00
陈景阳
e5d33b8982
fix 删除spider没有删除task
2019-09-05 20:07:08 +08:00
yaziming
888a3cab79
refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
...
detail:
1. add utils.BytesToString function instead of string() convert bytes to string.
2. use bytes.NewReader instead of strings.NewReader(string(sb)).
3. use w.Body.Bytes() instead of []byte(w.Body.String()).
2019-09-03 15:17:32 +08:00
陈景阳
6675d075f2
fix 删除spider没有删除task的问题
2019-09-02 20:49:00 +08:00
yaziming
9f43e08ff9
Backend:
...
improve
- AuthMiddleware 注入当前用户的信息
- 增加Context服务支持快捷获取当前登录者信息
- 重构Login/GetMe接口逻辑避免重复的数据库查询
- 规范化error信息声明(向下兼容,旧代码可逐渐迁移规范化)
- 修正部分不符合规范的代码
2019-08-31 21:26:56 +08:00
陈景阳
f098546a65
Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0
2019-08-28 16:00:27 +08:00
陈景阳
0186d08112
删除爬虫顺带删除文件
2019-08-27 09:39:16 +08:00
yaziming
b11f31ec18
JSON -> AbortWithStatusJSON
2019-08-26 23:13:26 +08:00
Marvin Zhang
aebd5cf522
Merge pull request #158 from hantmac/develop
...
modify unit test to use mock
2019-08-22 17:39:19 +08:00
hantmac
03fc2a8e54
modify unit test to use mock
2019-08-22 16:20:30 +08:00
Marvin Zhang
b286ec5193
Merge pull request #149 from hantmac/develop
...
Add unit test for routes/node
2019-08-19 19:06:35 +08:00
hantmac
6ad6a938fa
Add unit test for routes/node
2019-08-19 18:06:49 +08:00
陈景阳
122919658b
fix tmp 目录不会自动创建的问题
2019-08-18 18:45:19 +08:00
陈景阳
d882897957
fix Node节点删除问题
2019-07-30 16:06:35 +08:00
Marvin Zhang
f804fa937e
optimized user auth
2019-07-27 14:55:24 +08:00
Marvin Zhang
eea85faa5c
added user management
2019-07-27 00:56:37 +08:00
Marvin Zhang
a16f296167
added jwt
2019-07-27 00:00:59 +08:00
Marvin Zhang
be9339ff3f
added user login/signup
2019-07-26 23:02:30 +08:00
Marvin Zhang
dae5d67a10
added login page
2019-07-26 20:04:20 +08:00
Marvin Zhang
253c643e8e
added spider stats
2019-07-26 17:07:24 +08:00
Marvin Zhang
b5fd0f411b
added network diagram
2019-07-24 21:03:30 +08:00
Marvin Zhang
eb3c7d9f81
added file edit
2019-07-24 19:51:52 +08:00
Marvin Zhang
b01d265060
added file management
2019-07-24 13:37:03 +08:00
Marvin Zhang
072e60e17e
fetch sysinfo from remote
2019-07-22 22:25:29 +08:00
Marvin Zhang
8df06ba278
added sysinfo
2019-07-22 13:33:09 +08:00
Marvin Zhang
53cebde962
added golang
2019-07-22 12:51:52 +08:00