git-sync/crawlab
1
0
Fork 0
mirror of https://github.com/crawlab-team/crawlab.git synced 2026-01-22 17:31:03 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,154 Commits 6 Branches 35 Tags
a74b949d8db8cf56e24e8dcb3bb0408dc864fe7a
Commit Graph

79 Commits

Author SHA1 Message Date
marvzhang
a74b949d8d fixed https://github.com/crawlab-team/crawlab/issues/423 2020-01-06 12:35:17 +08:00
marvzhang
44c0b050f7 爬虫详情显示定时任务 2020-01-03 17:20:24 +08:00
marvzhang
2f47a929d0 解决上传爬虫报错问题 2019-12-27 17:24:23 +08:00
yaziming
6dced83896 fix(backend): 
临时解决修复偶发mongo多节点信息的问题，后续需重构
 2019-12-26 11:26:41 +08:00
marvzhang
44c9bde96f fixed https://github.com/crawlab-team/crawlab/issues/373 2019-12-19 10:42:20 +08:00
Marvin Zhang
32c07c5270 Merge pull request #370 from wo10378931/develop 
Develop
 2019-12-17 10:09:37 +08:00
marvzhang
3ef794f7a2 将可配置爬虫stages调整为列表 2019-12-13 12:55:53 +08:00
陈景阳
c64ea5c250 优化代码，添加注释 2019-12-12 20:52:09 +08:00
marvzhang
0cf745767c 修复定时任务不一致问题 2019-12-12 13:13:42 +08:00
陈景阳
b4c160fe22 完成可能重复注册节点的问题 2019-12-09 10:28:48 +08:00
陈景阳
0daeb33699 完成批量删除Task任务列表 2019-12-08 10:58:02 +08:00
陈景阳
6e7634d70f Feature 新增定时任务可暂停/运行 2019-12-07 14:02:54 +08:00
陈景阳
6fb831b322 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-12-07 10:58:24 +08:00
hantmac
a74fd82b6a - 新增authGroup.DELETE("/tasks_by_status", routes.DeleteTaskByStatus) 支持批量删除指定状态的任务 
- TaskListRequestData中增加Status字段，支持根据task状态进行筛选
 2019-12-05 15:12:32 +08:00
陈景阳
0c5ae35297 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-12-05 07:18:17 +08:00
marvzhang
be4a5f6667 优先调整xpath顺序 2019-12-04 13:57:27 +08:00
marvzhang
82c6b80063 更新Spiderfile模版 2019-12-03 14:25:54 +08:00
marvzhang
589190d674 加入Spiderfile模版 2019-12-03 13:37:41 +08:00
marvzhang
9c5c0bd270 更新可配置爬虫 2019-12-03 12:14:38 +08:00
marvzhang
e14c7fa80e 修复删除可配置爬虫问题 2019-11-28 22:20:20 +08:00
marvzhang
ba4f5fd20c 优化可配置爬虫前端界面 2019-11-28 21:36:17 +08:00
marvzhang
bc81462a80 加入修改可配置POST接口 2019-11-28 16:08:13 +08:00
marvzhang
f06c8eb785 准备前端可配置爬虫数据 2019-11-27 12:42:08 +08:00
marvzhang
2630802e6b Merge remote-tracking branch 'origin/develop' into develop 2019-11-27 12:41:51 +08:00
marvzhang
ded5703b13 准备前端可配置爬虫数据 2019-11-27 12:32:25 +08:00
marvzhang
88118cf894 准备前端可配置爬虫数据 2019-11-27 10:40:37 +08:00
Marvin Zhang
b6fba383d7 Merge pull request #321 from zhangweiii/master 
fix Cannot read property length of null when first init
 2019-11-27 10:02:21 +08:00
zhangweiii
8c72395ab7 fix Cannot read property length of null when first init 2019-11-27 09:45:16 +08:00
陈景阳
9bba946ba4 Merge remote-tracking branch 'upstream/develop' into upstream-develop 
# Conflicts:
#	backend/services/spider.go
 2019-11-26 15:30:26 +08:00
陈景阳
97e5d5b65f fix 执行爬虫错误的问题 2019-11-26 15:26:01 +08:00
marvzhang
bc5203267a 加入xpath 2019-11-26 13:02:49 +08:00
marvzhang
b8592b89ce 更新可配置爬虫，修复一些问题 2019-11-24 19:45:21 +08:00
marvzhang
6a07afa279 更新可配置爬虫，修复一些问题 2019-11-24 18:51:32 +08:00
marvzhang
38d103da39 加入可配置爬虫 2019-11-24 17:57:12 +08:00
marvzhang
442396a5ff fixed https://github.com/crawlab-team/crawlab/issues/315 2019-11-24 12:20:44 +08:00
陈景阳
484a7ec17c fix 优化代码 2019-10-28 12:03:02 +08:00
陈景阳
0648dacf4b 读取日志修改为2M 2019-10-28 11:38:39 +08:00
暗音
3937cba64f Merge branch 'develop' into develop 2019-10-28 11:06:13 +08:00
陈景阳
06d659b77a 修改日志获取问题 2019-10-17 17:54:19 +08:00
陈景阳
05136b0fac fix 定时任务参数错误的问题 2019-10-16 15:27:12 +08:00
陈景阳
cd7f6e66b4 fix 定时任务管理 2019-10-11 23:53:07 +08:00
陈景阳
02f744eb96 fix 2019-10-11 22:48:06 +08:00
陈景阳
c00bebbf95 优化节点信息 2019-10-11 21:57:25 +08:00
yaziming
2f6b517356 refactor(all): refactor code 
remove redundant code and some code refactor
 2019-10-11 16:01:57 +08:00
陈景阳
8294e7cb4b 完成爬虫的分类 2019-09-30 16:35:36 +08:00
陈景阳
ffd5725f3b 添加爬虫类型 2019-09-30 14:43:48 +08:00
陈景阳
d80642aa0c fix 删除爬虫的问题 2019-09-30 12:09:37 +08:00
陈景阳
31c708434d 打印一些错误的日志 2019-09-27 14:16:41 +08:00
陈景阳
f08ef3765f 新增几个方法 2019-09-27 12:31:47 +08:00
陈景阳
59fcf7e9b0 fix 重复获取爬虫的问题 2019-09-27 12:00:00 +08:00