Commit Graph

305 Commits

Author SHA1 Message Date
zkqiang
77f7e889ba fixed build error of windows 2020-09-20 12:35:21 +08:00
marvzhang
0a292248b4 added system tasks 2020-07-31 13:13:49 +08:00
marvzhang
154813ceff added part of the system tasks logic 2020-07-30 23:06:11 +08:00
marvzhang
375d7a96da added chromedriver 2020-07-30 12:02:11 +08:00
marvzhang
9616ba54c7 fixed https://github.com/crawlab-team/crawlab/issues/813 2020-07-26 17:38:12 +08:00
marvzhang
91e084a6a3 fixed https://github.com/crawlab-team/crawlab/issues/808 2020-07-20 21:52:32 +08:00
marvzhang
789b04b3ee added restart in task detail 2020-07-18 21:44:39 +08:00
marvzhang
b2dc58a592 updated node offline task update 2020-07-18 21:35:54 +08:00
marvzhang
5bcf2b13d8 added batch enable/disable schedules 2020-07-18 21:16:28 +08:00
marvzhang
2263332712 Merge branch 'develop' of github.com:crawlab-team/crawlab into develop 2020-07-15 11:19:38 +08:00
marvzhang
ccce1eb951 added spider market 2020-07-13 16:56:11 +08:00
zkqiang
72eea9589a fix stdout reader 2020-07-11 20:55:05 +08:00
marvzhang
8a2b7df148 fixed worker node failure issue 2020-07-08 11:36:35 +08:00
marvzhang
63747af427 fixed git issue 2020-07-08 10:25:58 +08:00
marvzhang
ac9a36d4a1 fixed https://github.com/crawlab-team/crawlab/issues/787 2020-07-03 17:28:07 +08:00
marvzhang
ffe9d5f6b6 fixed worker node unable to register issue 2020-07-02 12:07:07 +08:00
marvzhang
5130396da6 fixed git integration error 2020-07-01 15:13:51 +08:00
marvzhang
4ddb083a23 try to fix re-upload error 2020-06-30 22:07:00 +08:00
marvzhang
3ff96a237a added error notification for scrapy spiders 2020-06-18 12:54:12 +08:00
marvzhang
331fa3338b set default log expire time to 1 day 2020-06-07 21:29:28 +08:00
marvzhang
c3fedf8247 fixed unable to update node name issue 2020-06-07 12:36:09 +08:00
yaziming
fe9e1f65cf 修复子节点名称显示错误 2020-06-03 18:11:13 +08:00
yaziming
6fac8e6b17 修复子节点不能先注册的问题 2020-06-02 15:32:25 +08:00
yaziming
6687695438 解决节点不存在时,无法主动创建master节点的问题 2020-05-27 19:04:54 +08:00
yaziming
c02c58fd2d local node 2020-05-26 16:15:05 +08:00
marvzhang
4a60f43c44 fixed https://github.com/crawlab-team/crawlab/issues/747 2020-05-26 14:11:05 +08:00
yaziming
a15a695939 GetGitRemoteBranchesPlain 2020-05-25 19:12:35 +08:00
Marvin Zhang
7563bb660c Merge pull request #741 from yaziming/reactors/simplified-cluster-watcher
Reactors/simplified
2020-05-24 12:37:17 +08:00
yaziming
22774dd041 增加当前节点本地定时缓存,修改部分潜在BUG,启动时Mongo或者redis无法正常连接时,进入启动等待 2020-05-23 15:15:39 +08:00
yaziming
3d569abd43 GetRedisNode 2020-05-22 15:37:11 +08:00
yaziming
482aaa42eb simplified 2020-05-22 15:29:14 +08:00
yaziming
a55a9506a1 simplified 2020-05-22 15:24:49 +08:00
Marvin Zhang
f84a855455 Merge pull request #738 from yaziming/fix/resetting-the-git-url-not-take-effect
fix #728
2020-05-21 12:37:19 +08:00
yaziming
801b8c78cc fix #728 2020-05-20 14:55:47 +08:00
hantmac
e7c0bfadaf bug fix: fix es bug 2020-05-15 11:15:56 +08:00
marvzhang
46420cb39a code cleanup 2020-05-15 10:44:51 +08:00
marvzhang
f8e773d4f3 disable es logging 2020-05-15 10:43:04 +08:00
marvzhang
03a656619b disable es logging 2020-05-15 10:41:38 +08:00
marvzhang
ac05a84e6d Merge remote-tracking branch 'origin/develop' into develop 2020-05-15 10:35:15 +08:00
marvzhang
9716f94901 fixed https://github.com/crawlab-team/crawlab/issues/732 2020-05-15 10:34:52 +08:00
yaziming
33e2805326 refactor(backend): Upgrade the version that depends on the library gin
Upgrade the version that depends on the library gin
2020-05-09 17:18:10 +08:00
hantmac
7d0b0cc5cf support custom node name 2020-04-28 20:41:42 +08:00
hantmac
14159c46a5 support send log to ES 2020-04-27 15:59:06 +08:00
marvzhang
6446ec9c5a fixed https://github.com/crawlab-team/crawlab/issues/700 2020-04-23 14:58:55 +08:00
marvzhang
d0e7bcbd8f fixed https://github.com/crawlab-team/crawlab/issues/670 2020-04-21 13:31:11 +08:00
marvzhang
730349e28e 升级预装node.js 2020-04-21 12:54:02 +08:00
marvzhang
052757960e 加入Web Hook 2020-04-20 13:44:13 +08:00
marvzhang
b0a930ca32 结果集自动生成 2020-04-19 17:49:21 +08:00
marvzhang
bad2af5711 优化自动安装依赖 2020-04-19 17:26:08 +08:00
marvzhang
ef43e2a4ff 加入自动安装依赖 2020-04-19 16:56:07 +08:00