Commit Graph

41 Commits

Author SHA1 Message Date
陈景阳
cd7f6e66b4 fix 定时任务管理 2019-10-11 23:53:07 +08:00
陈景阳
02f744eb96 fix 2019-10-11 22:48:06 +08:00
陈景阳
c00bebbf95 优化节点信息 2019-10-11 21:57:25 +08:00
陈景阳
0d10d6d045 fix 创建目录错误的问题 2019-10-07 12:21:32 +08:00
陈景阳
8294e7cb4b 完成爬虫的分类 2019-09-30 16:35:36 +08:00
陈景阳
ffd5725f3b 添加爬虫类型 2019-09-30 14:43:48 +08:00
陈景阳
d80642aa0c fix 删除爬虫的问题 2019-09-30 12:09:37 +08:00
陈景阳
424e2a5e14 fix 重复获取爬虫的问题 2019-09-27 12:07:38 +08:00
陈景阳
7b93d8a67b fix 上传爬虫名称错误的问题 2019-09-27 11:30:38 +08:00
陈景阳
41e9edf940 完成爬虫列表 2019-09-26 20:53:05 +08:00
陈景阳
5416b7ac60 fix 上传的问题 2019-09-26 19:44:12 +08:00
陈景阳
6df6155daf 优化爬虫获取逻辑 2019-09-26 16:26:32 +08:00
陈景阳
475bf4c69e 优化爬虫获取逻辑 2019-09-26 11:38:13 +08:00
陈景阳
9237e62a48 爬虫逻辑修改为从GridFS获取 2019-09-26 11:28:20 +08:00
陈景阳
27f36cf91f 删除日志 2019-09-10 09:51:27 +08:00
陈景阳
9514a8a6af 重构msg的包 2019-09-10 09:32:48 +08:00
陈景阳
e5d33b8982 fix 删除spider没有删除task 2019-09-05 20:07:08 +08:00
yaziming
888a3cab79 refactor(backend): Use more efficient bytes to string methods and remove unnecessary type conversions
detail:
    1. add utils.BytesToString function instead of string() convert bytes to string.
    2. use bytes.NewReader instead of strings.NewReader(string(sb)).
    3. use w.Body.Bytes() instead of []byte(w.Body.String()).
2019-09-03 15:17:32 +08:00
陈景阳
6675d075f2 fix 删除spider没有删除task的问题 2019-09-02 20:49:00 +08:00
yaziming
9f43e08ff9 Backend:
improve
     - AuthMiddleware 注入当前用户的信息
     - 增加Context服务支持快捷获取当前登录者信息
     - 重构Login/GetMe接口逻辑避免重复的数据库查询
     - 规范化error信息声明(向下兼容,旧代码可逐渐迁移规范化)
     - 修正部分不符合规范的代码
2019-08-31 21:26:56 +08:00
陈景阳
f098546a65 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-28 16:00:27 +08:00
陈景阳
0186d08112 删除爬虫顺带删除文件 2019-08-27 09:39:16 +08:00
yaziming
b11f31ec18 JSON -> AbortWithStatusJSON 2019-08-26 23:13:26 +08:00
Marvin Zhang
aebd5cf522 Merge pull request #158 from hantmac/develop
modify unit test to use mock
2019-08-22 17:39:19 +08:00
hantmac
03fc2a8e54 modify unit test to use mock 2019-08-22 16:20:30 +08:00
Marvin Zhang
b286ec5193 Merge pull request #149 from hantmac/develop
Add unit test for routes/node
2019-08-19 19:06:35 +08:00
hantmac
6ad6a938fa Add unit test for routes/node 2019-08-19 18:06:49 +08:00
陈景阳
122919658b fix tmp 目录不会自动创建的问题 2019-08-18 18:45:19 +08:00
陈景阳
d882897957 fix Node节点删除问题 2019-07-30 16:06:35 +08:00
Marvin Zhang
f804fa937e optimized user auth 2019-07-27 14:55:24 +08:00
Marvin Zhang
eea85faa5c added user management 2019-07-27 00:56:37 +08:00
Marvin Zhang
a16f296167 added jwt 2019-07-27 00:00:59 +08:00
Marvin Zhang
be9339ff3f added user login/signup 2019-07-26 23:02:30 +08:00
Marvin Zhang
dae5d67a10 added login page 2019-07-26 20:04:20 +08:00
Marvin Zhang
253c643e8e added spider stats 2019-07-26 17:07:24 +08:00
Marvin Zhang
b5fd0f411b added network diagram 2019-07-24 21:03:30 +08:00
Marvin Zhang
eb3c7d9f81 added file edit 2019-07-24 19:51:52 +08:00
Marvin Zhang
b01d265060 added file management 2019-07-24 13:37:03 +08:00
Marvin Zhang
072e60e17e fetch sysinfo from remote 2019-07-22 22:25:29 +08:00
Marvin Zhang
8df06ba278 added sysinfo 2019-07-22 13:33:09 +08:00
Marvin Zhang
53cebde962 added golang 2019-07-22 12:51:52 +08:00