Commit Graph

216 Commits

Author SHA1 Message Date
hantmac
389da906ef 修改为递归修改文件夹权限 2019-11-28 10:26:14 +08:00
hantmac
429135eb46 bug fix 2019-11-27 23:05:35 +08:00
marvzhang
e88b13b510 准备前端可配置爬虫数据 2019-11-27 12:42:08 +08:00
marvzhang
1663be96ff Merge remote-tracking branch 'origin/develop' into develop 2019-11-27 12:41:51 +08:00
marvzhang
6449a8c5be 准备前端可配置爬虫数据 2019-11-27 12:32:25 +08:00
marvzhang
0edda7b558 加入前端可配置编辑器 2019-11-27 12:18:51 +08:00
marvzhang
1674dce3bd 准备前端可配置爬虫数据 2019-11-27 10:40:37 +08:00
Marvin Zhang
6bc3e0d64f Merge pull request #321 from zhangweiii/master
fix Cannot read property length of null when first init
2019-11-27 10:02:21 +08:00
zhangweiii
95a1b72ec4 fix Cannot read property length of null when first init 2019-11-27 09:45:16 +08:00
marvzhang
0d8ce3a29f 准备可配置爬虫后端数据 2019-11-26 13:38:54 +08:00
marvzhang
b676a84e49 加入xpath 2019-11-26 13:02:49 +08:00
marvzhang
bfce15d54e 加入Spiderfile限制条件 2019-11-26 12:44:24 +08:00
marvzhang
a87950e369 加入环境变量 2019-11-25 22:07:20 +08:00
marvzhang
dccfb23901 加入储存逻辑 2019-11-25 17:52:19 +08:00
marvzhang
1c32c92c54 refactor code 2019-11-25 16:45:55 +08:00
marvzhang
3f12302cf9 更新可配置爬虫:添加上传GridFS 2019-11-25 13:36:14 +08:00
marvzhang
5a286f98af 更新可配置爬虫,修复一些问题 2019-11-24 19:45:21 +08:00
marvzhang
8b451c8b2b 更新可配置爬虫,修复一些问题 2019-11-24 18:51:32 +08:00
marvzhang
9c282ddb4d 加入可配置爬虫 2019-11-24 17:57:12 +08:00
marvzhang
6d9c2ce653 Merge remote-tracking branch 'origin/develop' into develop 2019-11-24 12:25:46 +08:00
marvzhang
7003951561 fixed https://github.com/crawlab-team/crawlab/issues/315 2019-11-24 12:20:44 +08:00
Marvin Zhang
f1c951d575 Merge pull request #313 from hantmac/develop
bug fix
2019-11-24 11:34:50 +08:00
marvzhang
7b86d35a0f code cleanup 2019-11-23 18:16:24 +08:00
marvzhang
607ce70f5c 准备可配置爬虫 2019-11-23 18:13:47 +08:00
marvzhang
010968a7ce Merge remote-tracking branch 'origin/develop' into develop 2019-11-23 16:48:19 +08:00
marvzhang
464054d1c2 added vendor files 2019-11-23 16:47:05 +08:00
韩山杰
d4525116ea modity redis DialWriteTimeout to 15s 2019-11-22 22:29:02 +08:00
韩山杰
86d4c611c6 bug fix 2019-11-22 15:32:23 +08:00
Jeremy
7755c3e74c bug fix register.go
fix data race because of register solve issue https://github.com/crawlab-team/crawlab/issues/308
2019-11-19 17:03:46 +08:00
陈景阳
9427283e3a fix 循环依赖的问题 2019-10-28 13:51:12 +08:00
陈景阳
965553b285 fix 代码遗漏 2019-10-28 12:36:00 +08:00
陈景阳
76ab8f1fcd fix 优化代码 2019-10-28 12:03:02 +08:00
陈景阳
5525c82835 读取日志修改为2M 2019-10-28 11:38:39 +08:00
暗音
bcf3978600 Merge branch 'develop' into develop 2019-10-28 11:06:13 +08:00
陈景阳
418d728825 修改日志获取问题 2019-10-17 17:54:19 +08:00
陈景阳
4ab4892471 fix 环境变量的问题 2019-10-16 15:39:25 +08:00
陈景阳
b3b2efd611 fix 定时任务参数错误的问题 2019-10-16 15:27:12 +08:00
陈景阳
3fc97e78d8 fix 时区的问题 2019-10-16 11:26:15 +08:00
陈景阳
467796b55a fix 一些东西 2019-10-16 10:11:00 +08:00
陈景阳
f92d2d4266 优化代码 2019-10-16 09:45:50 +08:00
陈景阳
d4c152f93a 代码优化 2019-10-15 17:23:03 +08:00
陈景阳
04a35e8bec Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-10-12 07:16:37 +08:00
陈景阳
6af06efc17 fix worker无法获取到当前Node的问题 2019-10-12 07:16:11 +08:00
暗音
2d2034326a Merge pull request #4 from crawlab-team/master
同步源库
2019-10-12 06:41:34 +08:00
陈景阳
5bd30d8046 fix 定时任务管理 2019-10-11 23:53:07 +08:00
陈景阳
b56399451e fix 定时任务管理 2019-10-11 23:22:25 +08:00
陈景阳
7dae91ab50 fix 2019-10-11 22:48:06 +08:00
陈景阳
973251a0fb 优化节点信息 2019-10-11 21:57:25 +08:00
yaziming
738d607d78 ignore add super admin account error 2019-10-11 16:54:13 +08:00
yaziming
ee808e0e60 refactor(all): refactor code
remove redundant code and some code refactor
2019-10-11 16:01:57 +08:00