git-sync/crawlab
1
0
Fork 0
mirror of https://github.com/crawlab-team/crawlab.git synced 2026-01-23 17:31:11 +01:00
Code Issues Packages Projects Releases Wiki Activity
929 Commits 6 Branches 35 Tags
4e45447546ebbc15b26eaf73d8f69d5ce2e87bf6
Commit Graph

207 Commits

Author SHA1 Message Date
marvzhang
870bb167a7 准备可配置爬虫后端数据 2019-11-26 13:38:54 +08:00
marvzhang
bc5203267a 加入xpath 2019-11-26 13:02:49 +08:00
marvzhang
8046d94cc3 加入Spiderfile限制条件 2019-11-26 12:44:24 +08:00
marvzhang
e2e61c621e 加入环境变量 2019-11-25 22:07:20 +08:00
marvzhang
825962f8ba 加入储存逻辑 2019-11-25 17:52:19 +08:00
marvzhang
2e5468e4c1 refactor code 2019-11-25 16:45:55 +08:00
marvzhang
178e46dd93 更新可配置爬虫：添加上传GridFS 2019-11-25 13:36:14 +08:00
marvzhang
b8592b89ce 更新可配置爬虫，修复一些问题 2019-11-24 19:45:21 +08:00
marvzhang
6a07afa279 更新可配置爬虫，修复一些问题 2019-11-24 18:51:32 +08:00
marvzhang
38d103da39 加入可配置爬虫 2019-11-24 17:57:12 +08:00
marvzhang
c03c296436 Merge remote-tracking branch 'origin/develop' into develop 2019-11-24 12:25:46 +08:00
marvzhang
442396a5ff fixed https://github.com/crawlab-team/crawlab/issues/315 2019-11-24 12:20:44 +08:00
Marvin Zhang
966d3eaaf2 Merge pull request #313 from hantmac/develop 
bug fix
 2019-11-24 11:34:50 +08:00
marvzhang
b51fa81b79 code cleanup 2019-11-23 18:16:24 +08:00
marvzhang
b5c3ca9c32 准备可配置爬虫 2019-11-23 18:13:47 +08:00
marvzhang
9311a37a55 Merge remote-tracking branch 'origin/develop' into develop 2019-11-23 16:48:19 +08:00
marvzhang
2b26f7fa7e added vendor files 2019-11-23 16:47:05 +08:00
韩山杰
6741873f20 modity redis DialWriteTimeout to 15s 2019-11-22 22:29:02 +08:00
韩山杰
6c7d884e66 bug fix 2019-11-22 15:32:23 +08:00
Jeremy
7e406261c2 bug fix register.go 
fix data race because of register solve issue https://github.com/crawlab-team/crawlab/issues/308
 2019-11-19 17:03:46 +08:00
陈景阳
7a5fd69949 fix 循环依赖的问题 2019-10-28 13:51:12 +08:00
陈景阳
070242c5a2 fix 代码遗漏 2019-10-28 12:36:00 +08:00
陈景阳
484a7ec17c fix 优化代码 2019-10-28 12:03:02 +08:00
陈景阳
0648dacf4b 读取日志修改为2M 2019-10-28 11:38:39 +08:00
暗音
3937cba64f Merge branch 'develop' into develop 2019-10-28 11:06:13 +08:00
陈景阳
06d659b77a 修改日志获取问题 2019-10-17 17:54:19 +08:00
陈景阳
2acf33c885 fix 环境变量的问题 2019-10-16 15:39:25 +08:00
陈景阳
05136b0fac fix 定时任务参数错误的问题 2019-10-16 15:27:12 +08:00
陈景阳
ecab6dfa03 fix 时区的问题 2019-10-16 11:26:15 +08:00
陈景阳
5da64fd00b fix 一些东西 2019-10-16 10:11:00 +08:00
陈景阳
20fdb5f2d3 优化代码 2019-10-16 09:45:50 +08:00
陈景阳
a00fcee801 代码优化 2019-10-15 17:23:03 +08:00
陈景阳
91bee38c23 Merge remote-tracking branch 'upstream/develop' into upstream-develop 2019-10-12 07:16:37 +08:00
陈景阳
61d32857a7 fix worker无法获取到当前Node的问题 2019-10-12 07:16:11 +08:00
暗音
1373702f7f Merge pull request #4 from crawlab-team/master 
同步源库
 2019-10-12 06:41:34 +08:00
陈景阳
cd7f6e66b4 fix 定时任务管理 2019-10-11 23:53:07 +08:00
陈景阳
04924b2f19 fix 定时任务管理 2019-10-11 23:22:25 +08:00
陈景阳
02f744eb96 fix 2019-10-11 22:48:06 +08:00
陈景阳
c00bebbf95 优化节点信息 2019-10-11 21:57:25 +08:00
yaziming
805167e2da ignore add super admin account error 2019-10-11 16:54:13 +08:00
yaziming
2f6b517356 refactor(all): refactor code 
remove redundant code and some code refactor
 2019-10-11 16:01:57 +08:00
陈景阳
c58f213264 添加日志打印 2019-10-10 19:56:04 +08:00
yaziming
7557f54e4d feat(backend): support server graceful down 
1.support server graceful down
 2019-10-09 11:21:01 +08:00
暗音
c8bd748f68 Merge pull request #245 from wo10378931/develop 
Develop
 2019-10-08 20:28:47 +08:00
陈景阳
efd742f55d 修改版本号 2019-10-08 20:26:08 +08:00
陈景阳
45c2f85856 fix 状态的问题 2019-10-08 20:20:48 +08:00
陈景阳
86e33fc43a fix 状态的问题 2019-10-08 20:16:49 +08:00
陈景阳
80c70ec8ae fix 状态错误的问题 2019-10-08 19:41:29 +08:00
暗音
1ceb697fd2 Merge pull request #242 from wo10378931/develop 
Develop
 2019-10-07 13:07:53 +08:00
陈景阳
7c75c24f65 fix md5值不一致的问题 2019-10-07 12:49:37 +08:00