marvzhang
|
01aea28c9c
|
添加文件管理功能(后端)
|
2019-12-25 20:49:43 +08:00 |
|
hantmac
|
ec9525cb1a
|
fix
|
2019-12-24 16:44:54 +08:00 |
|
hantmac
|
893476bd0b
|
尝试解决节点重复注册问题
|
2019-12-24 16:11:24 +08:00 |
|
Marvin Zhang
|
ff405dd2ee
|
Merge pull request #370 from wo10378931/develop
Develop
|
2019-12-17 10:09:37 +08:00 |
|
陈景阳
|
935b3e2c47
|
去掉select 语句的break关键字
|
2019-12-17 10:07:38 +08:00 |
|
marvzhang
|
a067c1c1ad
|
将可配置爬虫stages调整为列表
|
2019-12-13 12:55:53 +08:00 |
|
陈景阳
|
d8061dbf8f
|
优化代码,添加注释
|
2019-12-12 20:52:09 +08:00 |
|
marvzhang
|
26227dd0dc
|
修复定时任务不一致问题
|
2019-12-12 13:13:42 +08:00 |
|
陈景阳
|
c071a93c5b
|
fix 同步锁可能异常的情况
|
2019-12-10 09:22:09 +08:00 |
|
陈景阳
|
280877a0ae
|
完成可能重复注册节点的问题
|
2019-12-09 10:28:48 +08:00 |
|
陈景阳
|
58df4c4a96
|
Feature 新增定时任务可暂停/运行
|
2019-12-07 14:02:54 +08:00 |
|
陈景阳
|
bff13e96dc
|
Merge remote-tracking branch 'upstream/develop' into upstream-develop
|
2019-12-07 10:58:24 +08:00 |
|
hantmac
|
6d7efa465d
|
新增authGroup.DELETE(/tasks_by_status, routes.DeleteTaskByStatus) 支持批量删除指定状态的任务
|
2019-12-06 10:08:45 +08:00 |
|
hantmac
|
07ce8e25fd
|
- 新增authGroup.DELETE("/tasks_by_status", routes.DeleteTaskByStatus) 支持批量删除指定状态的任务
- TaskListRequestData中增加Status字段,支持根据task状态进行筛选
|
2019-12-05 15:12:32 +08:00 |
|
marvzhang
|
f6ac1e00b3
|
Merge remote-tracking branch 'origin/develop' into develop
|
2019-12-05 11:52:08 +08:00 |
|
marvzhang
|
e8edf9dac4
|
添加运行类别
|
2019-12-05 11:51:54 +08:00 |
|
陈景阳
|
b445457243
|
Merge remote-tracking branch 'upstream/develop' into upstream-develop
|
2019-12-05 07:18:17 +08:00 |
|
陈景阳
|
761e5257da
|
Merge remote-tracking branch 'upstream/develop' into develop
|
2019-12-05 07:15:07 +08:00 |
|
marvzhang
|
3761d906c8
|
修复爬虫被覆盖的问题
|
2019-12-04 14:54:49 +08:00 |
|
marvzhang
|
6d9c162e9e
|
优先调整xpath顺序
|
2019-12-04 13:57:27 +08:00 |
|
marvzhang
|
7c1e52da88
|
Merge remote-tracking branch 'origin/develop' into develop
|
2019-12-02 13:32:44 +08:00 |
|
hantmac
|
f58c42c6be
|
fix
|
2019-12-02 11:14:15 +08:00 |
|
hantmac
|
0eba6754ae
|
fix panic because of interface{} is nil
|
2019-12-02 10:11:57 +08:00 |
|
marvzhang
|
5405dba540
|
加入可配置爬虫阶段设置
|
2019-11-30 10:58:54 +08:00 |
|
hantmac
|
ff6ab9a281
|
bug fix:修复手动或者自动删除日志后的报错
|
2019-11-29 13:52:03 +08:00 |
|
marvzhang
|
87546f0c88
|
准备可配置爬虫自定义设置变量
|
2019-11-29 13:42:50 +08:00 |
|
marvzhang
|
d65e37517e
|
优化可配置爬虫前端界面
|
2019-11-28 21:36:17 +08:00 |
|
marvzhang
|
8210fa6c20
|
加入修改可配置POST接口
|
2019-11-28 16:08:13 +08:00 |
|
hantmac
|
389da906ef
|
修改为递归修改文件夹权限
|
2019-11-28 10:26:14 +08:00 |
|
hantmac
|
429135eb46
|
bug fix
|
2019-11-27 23:05:35 +08:00 |
|
陈景阳
|
f8f4d561e9
|
Merge remote-tracking branch 'upstream/develop' into upstream-develop
# Conflicts:
# backend/services/spider.go
|
2019-11-26 15:30:26 +08:00 |
|
暗音
|
4f9d8635e5
|
Merge pull request #13 from crawlab-team/develop
Develop
|
2019-11-26 15:29:18 +08:00 |
|
陈景阳
|
fa4d8ddc50
|
fix 执行爬虫错误的问题
|
2019-11-26 15:26:01 +08:00 |
|
marvzhang
|
b676a84e49
|
加入xpath
|
2019-11-26 13:02:49 +08:00 |
|
marvzhang
|
bfce15d54e
|
加入Spiderfile限制条件
|
2019-11-26 12:44:24 +08:00 |
|
marvzhang
|
a87950e369
|
加入环境变量
|
2019-11-25 22:07:20 +08:00 |
|
marvzhang
|
1c32c92c54
|
refactor code
|
2019-11-25 16:45:55 +08:00 |
|
marvzhang
|
9c282ddb4d
|
加入可配置爬虫
|
2019-11-24 17:57:12 +08:00 |
|
marvzhang
|
7003951561
|
fixed https://github.com/crawlab-team/crawlab/issues/315
|
2019-11-24 12:20:44 +08:00 |
|
marvzhang
|
607ce70f5c
|
准备可配置爬虫
|
2019-11-23 18:13:47 +08:00 |
|
Jeremy
|
7755c3e74c
|
bug fix register.go
fix data race because of register solve issue https://github.com/crawlab-team/crawlab/issues/308
|
2019-11-19 17:03:46 +08:00 |
|
陈景阳
|
cb0018ef87
|
关闭日志打印
|
2019-11-04 19:58:26 +08:00 |
|
陈景阳
|
9427283e3a
|
fix 循环依赖的问题
|
2019-10-28 13:51:12 +08:00 |
|
暗音
|
bcf3978600
|
Merge branch 'develop' into develop
|
2019-10-28 11:06:13 +08:00 |
|
陈景阳
|
418d728825
|
修改日志获取问题
|
2019-10-17 17:54:19 +08:00 |
|
陈景阳
|
4ab4892471
|
fix 环境变量的问题
|
2019-10-16 15:39:25 +08:00 |
|
陈景阳
|
b3b2efd611
|
fix 定时任务参数错误的问题
|
2019-10-16 15:27:12 +08:00 |
|
陈景阳
|
3fc97e78d8
|
fix 时区的问题
|
2019-10-16 11:26:15 +08:00 |
|
陈景阳
|
467796b55a
|
fix 一些东西
|
2019-10-16 10:11:00 +08:00 |
|
陈景阳
|
f92d2d4266
|
优化代码
|
2019-10-16 09:45:50 +08:00 |
|