Commit Graph

275 Commits

Author SHA1 Message Date
yaziming
482aaa42eb simplified 2020-05-22 15:29:14 +08:00
yaziming
a55a9506a1 simplified 2020-05-22 15:24:49 +08:00
Marvin Zhang
f84a855455 Merge pull request #738 from yaziming/fix/resetting-the-git-url-not-take-effect
fix #728
2020-05-21 12:37:19 +08:00
yaziming
801b8c78cc fix #728 2020-05-20 14:55:47 +08:00
hantmac
e7c0bfadaf bug fix: fix es bug 2020-05-15 11:15:56 +08:00
marvzhang
46420cb39a code cleanup 2020-05-15 10:44:51 +08:00
marvzhang
f8e773d4f3 disable es logging 2020-05-15 10:43:04 +08:00
marvzhang
03a656619b disable es logging 2020-05-15 10:41:38 +08:00
marvzhang
ac05a84e6d Merge remote-tracking branch 'origin/develop' into develop 2020-05-15 10:35:15 +08:00
marvzhang
9716f94901 fixed https://github.com/crawlab-team/crawlab/issues/732 2020-05-15 10:34:52 +08:00
yaziming
33e2805326 refactor(backend): Upgrade the version that depends on the library gin
Upgrade the version that depends on the library gin
2020-05-09 17:18:10 +08:00
hantmac
7d0b0cc5cf support custom node name 2020-04-28 20:41:42 +08:00
hantmac
14159c46a5 support send log to ES 2020-04-27 15:59:06 +08:00
marvzhang
6446ec9c5a fixed https://github.com/crawlab-team/crawlab/issues/700 2020-04-23 14:58:55 +08:00
marvzhang
d0e7bcbd8f fixed https://github.com/crawlab-team/crawlab/issues/670 2020-04-21 13:31:11 +08:00
marvzhang
730349e28e 升级预装node.js 2020-04-21 12:54:02 +08:00
marvzhang
052757960e 加入Web Hook 2020-04-20 13:44:13 +08:00
marvzhang
b0a930ca32 结果集自动生成 2020-04-19 17:49:21 +08:00
marvzhang
bad2af5711 优化自动安装依赖 2020-04-19 17:26:08 +08:00
marvzhang
ef43e2a4ff 加入自动安装依赖 2020-04-19 16:56:07 +08:00
marvzhang
6508e80de5 加入日志自动删除 2020-04-19 13:50:06 +08:00
marvzhang
be43bfc4f7 调整日志插入时间 2020-04-19 11:41:58 +08:00
marvzhang
9e3cc909f3 优化日志插入 2020-04-19 11:29:50 +08:00
marvzhang
5a8da7ed29 优化日志异常展示 2020-04-19 11:07:39 +08:00
marvzhang
59b42ddde2 加入日志异常检测 2020-04-19 10:32:36 +08:00
marvzhang
55cf81a6a0 优化日志分页 2020-04-18 16:06:38 +08:00
marvzhang
a07c001ccb 优化日志 2020-04-16 13:54:22 +08:00
marvzhang
624972fc73 加入日志分页 2020-04-15 13:48:27 +08:00
marvzhang
7057608ef7 迁移日志到MongoDB 2020-04-01 16:52:23 +08:00
marvzhang
5473f2436c fixed issue 2020-03-30 13:09:38 +08:00
marvzhang
12ff76e846 fixed https://github.com/crawlab-team/crawlab/issues/659 2020-03-30 12:57:43 +08:00
marvzhang
1ddeaef69b 加入重试 2020-03-29 15:45:25 +08:00
marvzhang
bff9356a0f 支持去重 2020-03-29 11:17:38 +08:00
marvzhang
92577e3d74 fixed https://github.com/crawlab-team/crawlab/issues/640 2020-03-24 23:24:45 +08:00
marvzhang
75fd8caa3e fixed https://github.com/crawlab-team/crawlab/issues/640 2020-03-24 23:14:10 +08:00
marvzhang
83c657dc49 fixed https://github.com/crawlab-team/crawlab/issues/643 https://github.com/crawlab-team/crawlab/issues/640 2020-03-24 08:19:45 +08:00
marvzhang
6a30bd1ab0 修复CLI上传Scrapy爬虫无法点击运行问题 2020-03-23 14:03:44 +08:00
marvzhang
fa62e1a2dc 加入权限管理 2020-03-20 17:43:11 +08:00
marvzhang
1e2b580ed4 加入ScheduleId到Task 2020-03-20 08:33:30 +08:00
marvzhang
40ad7fb9f3 加入挑战 2020-03-19 18:56:59 +08:00
marvzhang
daef59be07 updated contributors 2020-03-19 11:13:25 +08:00
marvzhang
e0d953d18f 用户挑战基础准备 2020-03-18 18:00:25 +08:00
marvzhang
0d612e92cf 加入检测scrapy配置 2020-03-12 09:21:55 +08:00
marvzhang
994db8d03c 加入Git Checkout
功能
2020-03-11 15:18:42 +08:00
marvzhang
b65c03107e 支持Git Log 2020-03-11 14:58:51 +08:00
marvzhang
6c3bcaea9c 加入git 日志 2020-03-11 14:01:02 +08:00
marvzhang
e1e59b51f0 安装界面优化 2020-03-11 10:22:39 +08:00
marvzhang
3123752038 配置加载demo爬虫 2020-03-11 08:16:52 +08:00
marvzhang
d2ed7e6379 加入配置只在工作节点上调度 2020-03-11 08:05:37 +08:00
marvzhang
74b1f509db code cleanup 2020-03-11 07:43:32 +08:00