git-sync/crawlab
1
0
Fork 0
mirror of https://github.com/crawlab-team/crawlab.git synced 2026-01-21 17:21:09 +01:00
Code Issues Packages Projects Releases Wiki Activity

updated README

Browse Source
This commit is contained in:
marvzhang
2020-01-10 17:22:14 +08:00
parent 65261a5797
commit 95083bc47c
2 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README-zh.md
View File

@@ -139,7 +139,7 @@ Docker部署的详情，请见[相关文档](https://tikazyq.github.io/crawlab-d
Crawlab的架构包括了一个主节点（Master Node）和多个工作节点（Worker Node），以及负责通信和数据储存的Redis和MongoDB数据库。
![](https://raw.githubusercontent.com/tikazyq/crawlab-docs/master/images/architecture.png)
![](http://static-docs.crawlab.cn/architecture.png)
前端应用向主节点请求数据，主节点通过MongoDB和Redis来执行任务派发调度以及部署，工作节点收到任务之后，开始执行爬虫任务，并将任务结果储存到MongoDB。架构相对于`v0.3.0`之前的Celery版本有所精简，去除了不必要的节点监控模块Flower，节点监控主要由Redis完成。

2
README.md
View File

@@ -137,7 +137,7 @@ For Docker Deployment details, please refer to [relevant documentation](https://
The architecture of Crawlab is consisted of the Master Node and multiple Worker Nodes, and Redis and MongoDB databases which are mainly for nodes communication and data storage.
![](https://raw.githubusercontent.com/tikazyq/crawlab-docs/master/images/architecture.png)
![](http://static-docs.crawlab.cn/architecture.png)
The frontend app makes requests to the Master Node, which assigns tasks and deploys spiders through MongoDB and Redis. When a Worker Node receives a task, it begins to execute the crawling task, and stores the results to MongoDB. The architecture is much more concise compared with versions before `v0.3.0`. It has removed unnecessary Flower module which offers node monitoring services. They are now done by Redis.