diff --git a/README-zh.md b/README-zh.md index 2f407f00..8fdcb0c9 100644 --- a/README-zh.md +++ b/README-zh.md @@ -20,25 +20,10 @@ ## 安装 -```bash -# 安装后台类库 -pip install -r requirements.txt -``` - -```bash -# 安装前台类库 -cd frontend -npm install -``` - -## 配置 - -请更改配置文件`config.py`,配置API和数据库连接. - -## 快速开始 -```bash -python manage.py serve -``` +三种方式: +1. [Docker](https://tikazyq.github.io/crawlab/Installation/Docker.md)(推荐) +2. [直接部署](https://tikazyq.github.io/crawlab/Installation/Direct.md) +3. [预览模式](https://tikazyq.github.io/crawlab/Installation/Direct.md)(快速体验) ## 截图 @@ -48,7 +33,7 @@ python manage.py serve #### 爬虫列表 - + #### 爬虫详情 - 概览 @@ -56,52 +41,42 @@ python manage.py serve #### 任务详情 - 抓取结果 - - -## 使用流程 - - + ## 架构 -Crawlab的架构跟Celery非常相似,但是加入了包括前端、爬虫、Flower在内的额外模块,以支持爬虫管理的功能。 +Crawlab的架构跟Celery非常相似,但是加入了包括前端、爬虫、Flower在内的额外模块,以支持爬虫管理的功能。架构图如下。 - + -### 节点 +### 节点 Node -节点其实就是Celery中的Worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。 +节点其实就是Celery中的`worker`。一个节点运行时会连接到一个任务队列(例如`Redis`)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。 -### 爬虫 +### 后台应用 Backend App -##### 自动发现 +这是一个Flask应用,提供了必要的API来支持常规操作,例如CRUD、爬虫部署以及任务运行。每一个节点需要启动Flask应用来支持爬虫部署。运行`python app.py`来启动应用。 -在`config.py`文件中,修改变量`PROJECT_SOURCE_FILE_FOLDER`作为爬虫项目所在的目录。Crawlab后台程序会自动发现这些爬虫项目并储存到数据库中。是不是很方便? +### 爬虫 Spider -##### 部署爬虫 +爬虫源代码或配置规则储存在`App`上,需要被部署到各个`worker`节点中。 -所有爬虫需要在抓取前被部署当相应当节点中。在"爬虫详情"页面点击"Deploy"按钮,爬虫将被部署到所有有效到节点中。 - -##### 运行爬虫 - -部署爬虫之后,你可以在"爬虫详情"页面点击"Run"按钮来启动爬虫。一个爬虫任务将被触发,你可以在任务列表页面中看到这个任务。 - -### 任务 +### 任务 Task 任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。 -### 后台应用 - -这是一个Flask应用,提供了必要的API来支持常规操作,例如CRUD、爬虫部署以及任务运行。每一个节点需要启动Flask应用来支持爬虫部署。运行`python manage.py app`或`python ./bin/run_app.py`来启动应用。 - -### 中间者 +### 中间者 Broker 中间者跟Celery中定义的一样,作为运行异步任务的队列。 -### 前端 +### 前端 Frontend 前端其实就是一个基于[Vue-Element-Admin](https://github.com/PanJiaChen/vue-element-admin)的单页应用。其中重用了很多Element-UI的控件来支持相应的展示。 +### Flower + +一个Celery的插件,用于监控Celery节点。 + ## 与其他框架的集成 任务是利用python的`subprocess`模块中的`Popen`来实现的。任务ID将以环境变量`CRAWLAB_TASK_ID`的形式存在于爬虫任务运行的进程中,并以此来关联抓取数据。 @@ -151,26 +126,11 @@ Crawlab使用起来很方便,也很通用,可以适用于几乎任何主流 | [ScrapydWeb](https://github.com/my8100/scrapydweb) | 管理平台 | Y | Y | Y | [Scrapyd](https://github.com/scrapy/scrapyd) | 网络服务 | Y | N | N/A -## TODOs -##### 后端 -- [ ] 文件管理 -- [ ] MySQL数据库支持 -- [ ] 重跑任务 -- [ ] 节点监控 -- [ ] 更多爬虫例子 - -##### 前端 -- [x] 任务数据统计 -- [x] 表格过滤 -- [x] 多语言支持 (中文) -- [ ] 登录和用户管理 -- [ ] 全局搜索 - ## 社区 & 赞助 如果您觉得Crawlab对您的日常开发或公司有帮助,请加作者微信 tikazyq1 并注明"Crawlab",作者会将你拉入群。或者,您可以扫下方支付宝二维码给作者打赏去升级团队协作软件或买一杯咖啡。
-
-
+
+
Crawlab的架构跟Celery非常相似,但是加入了包括前端、爬虫、Flower在内的额外模块,以支持爬虫管理的功能。架构图如下。
+
节点其实就是Celery中的worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。
这是一个Flask应用,提供了必要的API来支持常规操作,例如CRUD、爬虫部署以及任务运行。每一个节点需要启动Flask应用来支持爬虫部署。运行python app.py来启动应用。
爬虫源代码或配置规则储存在App上,需要被部署到各个worker节点中。
任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。
+中间者跟Celery中定义的一样,作为运行异步任务的队列。
+前端其实就是一个基于Vue-Element-Admin的单页应用。其中重用了很多Element-UI的控件来支持相应的展示。
+一个Celery的插件,用于监控Celery节点。
在config.py文件中,修改变量PROJECT_SOURCE_FILE_FOLDER作为爬虫项目所在的目录。Crawlab后台程序会自动发现这些爬虫项目并储存到数据库中。是不是很方便?
所有爬虫需要在抓取前被部署当相应当节点中。在"爬虫详情"页面点击"Deploy"按钮,爬虫将被部署到所有有效到节点中。
-部署爬虫之后,你可以在"爬虫详情"页面点击"Run"按钮来启动爬虫。一个爬虫任务将被触发,你可以在任务列表页面中看到这个任务。
- - -以下是Crawlab跟Scrapy集成的例子,利用了Crawlab传过来的task_id和collection_name。
import os
+from pymongo import MongoClient
+
+MONGO_HOST = '192.168.99.100'
+MONGO_PORT = 27017
+MONGO_DB = 'crawlab_test'
+
+# scrapy example in the pipeline
+class JuejinPipeline(object):
+ mongo = MongoClient(host=MONGO_HOST, port=MONGO_PORT)
+ db = mongo[MONGO_DB]
+ col_name = os.environ.get('CRAWLAB_COLLECTION')
+ if not col_name:
+ col_name = 'test'
+ col = db[col_name]
+
+ def process_item(self, item, spider):
+ item['task_id'] = os.environ.get('CRAWLAB_TASK_ID')
+ self.col.save(item)
+ return item
+
直接部署是之前没有Docker时的部署方式,相对于Docker部署来说有些繁琐。但了解如何直接部署可以帮助更深入地理解Docker是如何构建Crawlab镜像的。这里简单介绍一下。
+首先是将github上的代码拉取到本地。
+git clone https://github.com/tikazyq/crawlab
+
+安装前端所需库。
+npm install -g yarn pm2
+cd frontend
+yarn install
+
+安装后端所需库。
+cd ../crawlab
+pip install -r requirements
+
+分别配置前端配置文件./frontend/.env.production和后端配置文件./crawlab/config/config.py。分别需要对部署后API地址以及数据库地址进行配置。
这里的构建是指前端构建,需要执行以下命令。
+cd ../frontend
+npm run build:prod
+
+构建完成后,会在./frontend目录下创建一个dist文件夹,里面是打包好后的静态文件。
安装nginx,在ubuntu 16.04是以下命令。
sudo apt-get install nginx
+
+添加/etc/nginx/conf.d/crawlab.conf文件,输入以下内容。
server {
+ listen 8080;
+ server_name dev.crawlab.com;
+ root /home/yeqing/jenkins_home/workspace/crawlab_develop/frontend/dist;
+ index index.html;
+}
+其中,root是静态文件的根目录,这里是npm打包好后的静态文件。
现在,只需要启动nginx服务就完成了启动前端服务。
nginx reload
+
+这里是指启动后端服务。我们用pm2来管理进程。执行以下命令。
pm2 start app.py # API服务
+pm2 start worker.py # Worker
+pm2 start flower.py # Flower
+
+这样,pm2会启动3个守护进程来管理这3个服务。我们如果想看后端服务的日志的话,可以执行以下命令。
pm2 logs [app]
+
+然后在浏览器中输入http://localhost:8080就可以看到界面了。
这应该是部署应用的最方便也是最节省时间的方式了。在最近的一次版本更新v0.2.3中,我们发布了Docker功能,让大家可以利用Docker来轻松部署Crawlab。下面将一步一步介绍如何使用Docker来部署Crawlab。
+对Docker不了解的开发者,可以参考一下这篇文章(9102 年了,学点 Docker 知识)做进一步了解。简单来说,Docker可以利用已存在的镜像帮助构建一些常用的服务和应用,例如Nginx、MongoDB、Redis等等。用Docker运行一个MongoDB服务仅需docker run -d --name mongo -p 27017:27017 mongo一行命令。如何安装Docker跟操作系统有关,这里就不展开讲了,需要的同学自行百度一下相关教程。
我们已经在DockerHub上构建了Crawlab的镜像,开发者只需要将其pull下来使用。在pull 镜像之前,我们需要配置一下镜像源。因为我们在墙内,使用原有的镜像源速度非常感人,因此将使用DockerHub在国内的加速器。创建/etc/docker/daemon.json文件,在其中输入如下内容。
{
+ "registry-mirrors": ["https://registry.docker-cn.com"]
+}
+
+这样的话,pull镜像的速度会比不改变镜像源的速度快很多。
+执行以下命令将Crawlab的镜像下载下来。镜像大小大概在几百兆,因此下载需要几分钟时间。
+docker pull tikazyq/crawlab:latest
+
+拷贝一份后端配置文件./crawlab/config/config.py以及前端配置文件./frontend/.env.production到某一个地方。例如我的例子,分别为/home/yeqing/config.py和/home/yeqing/.env.production。
更改后端配置文件config.py,将MongoDB、Redis的指向IP更改为自己数据的值。注意,容器中对应的宿主机的IP地址不是localhost,而是172.17.0.1(当然也可以用network来做,只是稍微麻烦一些)。更改前端配置文件.env.production,将API地址VUE_APP_BASE_URL更改为宿主机所在的IP地址,例如http://192.168.0.8:8000,这将是前端调用API会用到的URL。
更改好配置文件之后,接下来就是运行容器了。执行以下命令来启动容器。
+docker run -d --rm --name crawlab \
+ -p 8080:8080 \
+ -p 8000:8000 \
+ -v /home/yeqing/.env.production:/opt/crawlab/frontend/.env.production \
+ -v /home/yeqing/config.py:/opt/crawlab/crawlab/config/config.py \
+ tikazyq/crawlab master
+
+其中,我们映射了8080端口(Nginx前端静态文件)以及8000端口(后端API)到宿主机。另外还将前端配置文件/home/yeqing/.env.production和后端配置文件/home/yeqing/config.py映射到了容器相应的目录下。传入参数master是代表该启动方式为主机启动模式,也就是所有服务(前端、Api、Flower、Worker)都会启动。另外一个模式是worker模式,只会启动必要的Api和Worker服务,这个对于分布式部署比较有用。等待大约20-30秒的时间来build前端静态文件,之后就可以打开Crawlab界面地址地址看到界面了。界面地址默认为http://localhost:8080。
当然,也可以用docker-compose的方式来部署。docker-compose是一个集群管理方式,可以利用名为docker-compose.yml的yaml文件来定义需要启动的容器,可以是单个,也可以(通常)是多个的。Crawlab的docker-compose.yml定义如下。
version: '3.3'
+services:
+ master:
+ image: tikazyq/crawlab:latest
+ container_name: crawlab
+ volumns:
+ - /home/yeqing/config.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件
+ - /home/yeqing/.env.production:/opt/crawlab/frontend/.env.production # 前端配置文件
+ ports:
+ - "8080:8080" # nginx
+ - "8000:8000" # app
+ depends_on:
+ - mongo
+ - redis
+ entrypoint:
+ - /bin/sh
+ - /opt/crawlab/docker_init.sh
+ - master
+ mongo:
+ image: mongo:latest
+ restart: always
+ ports:
+ - "27017:27017"
+ redis:
+ image: redis:latest
+ restart: always
+ ports:
+ - "6379:6379"
+
+这里先定义了master节点,也就是Crawlab的主节点。master依赖于mongo和redis容器,因此在启动之前会同时启动mongo和redis容器。这样就不需要单独配置mongo和redis服务了,大大节省了环境配置的时间。
安装docker-compose也很简单,大家去网上百度一下就可以了。
安装完docker-compose和定义好docker-compose.yml后,只需要运行以下命令就可以启动Crawlab。
docker-compose up
+
+同样,在浏览器中输入http://localhost:8080就可以看到界面。
docker-compose的方式很适合多节点部署,在原有的master基础上增加几个worker节点,达到多节点部署的目的。将docker-compose.yml更改为如下内容。
version: '3.3'
+services:
+ master:
+ image: tikazyq/crawlab:latest
+ container_name: crawlab
+ volumns:
+ - /home/yeqing/config.master.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件
+ - /home/yeqing/.env.production.master:/opt/crawlab/frontend/.env.production # 前端配置文件
+ ports:
+ - "8080:8080" # nginx
+ - "8000:8000" # app
+ depends_on:
+ - mongo
+ - redis
+ entrypoint:
+ - /bin/sh
+ - /opt/crawlab/docker_init.sh
+ - master
+ worker1:
+ image: tikazyq/crawlab:latest
+ volumns:
+ - /home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件
+ - /home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.production # 前端配置文件
+ ports:
+ - "8001:8000" # app
+ depends_on:
+ - mongo
+ - redis
+ entrypoint:
+ - /bin/sh
+ - /opt/crawlab/docker_init.sh
+ - worker
+ worker2:
+ image: tikazyq/crawlab:latest
+ volumns:
+ - /home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件
+ - /home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.production # 前端配置文件
+ ports:
+ - "8002:8000" # app
+ depends_on:
+ - mongo
+ - redis
+ entrypoint:
+ - /bin/sh
+ - /opt/crawlab/docker_init.sh
+ - worker
+ mongo:
+ image: mongo:latest
+ restart: always
+ ports:
+ - "27017:27017"
+ redis:
+ image: redis:latest
+ restart: always
+ ports:
+ - "6379:6379"
+
+这里启动了多增加了两个worker节点,以worker模式启动。这样,多节点部署,也就是分布式部署就完成了。
预览模式是一种让用户比较快的上手的一种部署模式。跟直接部署类似,但不用经过构建、nginx和启动服务的步骤。在启动时只需要执行以下命令就可以了。相较于直接部署来说方便一些。
python manage.py serve
+
+该模式同样会启动3个后端服务和1个前端服务。前端服务是通过npm run serve来进行的,因此是开发者模式。注意:强烈不建议在生产环境中用预览模式。预览模式只是让开发者快速体验Crawlab以及调试代码问题的一种方式,而不是用作生产环境部署的。
本小节将介绍三种安装Docker的方式:
+最快安装Crawlab的方式是克隆一份代码到本地
-git clone https://github.com/tikazyq/crawlab
-
-安装类库
-# 安装后台类库
-pip install -r requirements.txt
-
-# 安装前台类库
-cd frontend
-npm install
-
-
-
- 在运行之前需要对Crawlab进行一些配置,配置文件为config.py。
# project variables
-PROJECT_SOURCE_FILE_FOLDER = '/Users/yeqing/projects/crawlab/spiders' # 爬虫源码根目录
-PROJECT_DEPLOY_FILE_FOLDER = '/var/crawlab' # 爬虫部署根目录
-PROJECT_LOGS_FOLDER = '/var/logs/crawlab' # 日志目录
-PROJECT_TMP_FOLDER = '/tmp' # 临时文件目录
-
-# celery variables
-BROKER_URL = 'redis://192.168.99.100:6379/0' # 中间者URL,连接redis
-CELERY_RESULT_BACKEND = 'mongodb://192.168.99.100:27017/' # CELERY后台URL
-CELERY_MONGODB_BACKEND_SETTINGS = {
- 'database': 'crawlab_test',
- 'taskmeta_collection': 'tasks_celery',
-}
-CELERY_TIMEZONE = 'Asia/Shanghai'
-CELERY_ENABLE_UTC = True
-
-# flower variables
-FLOWER_API_ENDPOINT = 'http://localhost:5555/api' # Flower服务地址
-
-# database variables
-MONGO_HOST = '192.168.99.100'
-MONGO_PORT = 27017
-MONGO_DB = 'crawlab_test'
-
-# flask variables
-DEBUG = True
-FLASK_HOST = '127.0.0.1'
-FLASK_PORT = 8000
-
-启动后端API,也就是一个Flask App,可以直接启动,或者用gunicorn代替。
-python manage.py app
-
-启动本地Worker。在其他节点中如果想只是想执行任务的话,只需要启动这一个服务就可以了。
-python manage.py worker
-
-启动前端服务器。
-cd frontend
-npm run serve
-
-
-
- 后面我们需要让爬虫运行在各个节点上,需要让主机与节点进行通信,因此需要知道节点的IP地址和端口。我们需要手动配置一下节点的IP和端口。在节点列表中点击操作列里的蓝色查看按钮进入到节点详情。节点详情样子如下。

在右侧分别输入该节点对应的节点IP和节点端口,然后点击保存按钮,保存该节点信息。
这样,我们就完成了节点的配置工作。
+ + +定时任务是指定某个时刻,重复性地执行的任务,英文叫做Periodical Tasks,在Linux中也被称为Crontab。定时任务可以让任务可以被执行多次,而用户则不用手动的操作来执行任务。在生产环境中,这非常常见。定时任务对于对增量抓取或对数据实时性有要求的用户来说非常有用。
在Crawlab中,定时任务是通过apscheduler来实现的。创建一个定时任务之后,会在名为mongo的jobstore中创建一个periodical job,apscheduler调度引擎将会不断的去数据库中匹配任务的执行时间,如果执行时间满足要求,则会在后台触发一次任务运行。
定时任务列表会进行更新。每一次爬虫更新、删除、创建,以及定时任务的更新、删除、创建,都会触发定时任务列表的更新。
+导航至定时任务页面,可以看到定时任务的列表。
点击添加定时任务,弹出创建定时任务的弹框。填写相应的内容,点击提交按钮创建定时任务。

这里的Cron跟Linux中的crontab是一致的。如果对crontab不了解,可以参考这篇文章。
导航至定时任务页面,点击操作列的修改按钮,弹出修改定时任务的弹框。填写相应的内容,点击提交按钮修改定时任务。
导航至定时任务页面,点击操作列的删除按钮,确认删除该任务。
可配置爬虫是版本v0.2.1开发的功能。目的是将具有相似网站结构的爬虫项目可配置化,将开发爬虫的过程流程化,大大提高爬虫开发效率。
+Crawlab的可配置爬虫是基于Scrapy的,因此天生支持并发。而且,可配置爬虫完全支持自定义爬虫的一般功能,因此也支持任务调度、任务监控、日志监控、数据分析。
+在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮。
点击可配置爬虫。
+输入完基本信息,点击添加。
+添加完成后,可以看到刚刚添加的可配置爬虫出现了在最下方,点击查看进入到爬虫详情。
+点击配置标签进入到配置页面。接下来,我们需要对爬虫规则进行配置。
+这里已经有一些配置好的初始输入项。我们简单介绍一下各自的含义。
+这也是爬虫抓取采用的策略,也就是爬虫遍历网页是如何进行的。作为第一个版本,我们有仅列表、仅详情页、列表+详情页。
+这里我们选择列表+详情页。
+列表项的匹和分页按钮的匹配查询,由CSS或XPath来进行匹配。
+爬虫最开始遍历的网址。
+这个默认是开启的。如果开启,爬虫将先抓取网站的robots.txt并判断页面是否可抓;否则,不会对此进行验证。用户可以选择将其关闭。请注意,任何无视Robots协议的行为都有法律风险。
+这些都是再列表页或详情页中需要提取的字段。字段由CSS选择器或者XPath来匹配提取。可以选择文本或者属性。
+在检查完目标网页的元素CSS选择器之后,我们输入列表项选择器、开始URL、列表页/详情页等信息。注意勾选url为详情页URL。
+点击保存、预览,查看预览内容。
+自定义爬虫是指用户可以添加的任何语言任何框架的爬虫,高度自定义化。当用户添加好自定义爬虫之后,Crawlab就可以将其集成到爬虫管理的系统中来。
+自定义爬虫的添加有两种方式:
+在通过Web界面上传之前,需要将爬虫项目文件打包成zip格式。

然后,在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮,选择自定义爬虫,点击上传按钮,选择刚刚打包好的zip文件。上传成功后,爬虫列表中会出现新添加的自定义爬虫。这样就算添加好了。
这个方式稍微有些繁琐,但是对于无法轻松获取服务器的读写权限时是非常有用的,适合在生产环境上使用。
+Crawlab会自动发现PROJECT_SOURCE_FILE_FOLDER目录下的所有爬虫目录,并将这些目录生成自定义爬虫并集成到Crawlab中。因此,将爬虫项目目录拷贝到PROJECT_SOURCE_FILE_FOLDER目录下,就可以添加一个爬虫了。
这种方式非常方便,但是需要获得主机服务器的读写权限,因而比较适合在开发环境上采用。
+在定义爬虫中,我们需要配置一下执行命令(运行爬虫时后台执行的shell命令)和结果集(通过CRAWLAB_COLLECTION传递给爬虫程序,爬虫程序存储结果的地方),然后点击保存按钮保存爬虫信息。

接下来,我们就可以部署、运行自定义爬虫了。
+ + +这里的爬虫部署是指自定义爬虫的部署,因为可配置爬虫已经内嵌到Crawlab中了,所有节点都可以使用,不需要额外部署。简单来说,就是将主机上的爬虫源代码通过HTTP的方式打包传输至worker节点上,因此节点就可以运行传输过来的爬虫了。
部署爬虫很简单,有三种方式:
+爬虫列表中点击部署所有爬虫,将所有爬虫部署到所有在线节点中;爬虫列表中点击操作列的部署按钮,将指定爬虫部署到所有在线节点中;爬虫详情的概览标签中,点击部署按钮,将指定爬虫部署到所有在线节点中。部署好之后,我们就可以运行爬虫了。
+ + +我们有两种运行爬虫的方式:
+爬虫列表中操作列点击运行按钮,或者爬虫详情中概览标签下点击运行按钮,或者自定义爬虫,可以在配置标签下点击运行按钮然后,Crawlab会提示任务已经派发到队列中去了,然后你可以在爬虫详情左侧看到新创建的任务。点击创建时间可以导航至任务详情。
定时任务触发是比较常用的功能,对于增量抓取或对实时性有要求的任务很重要。这在定时任务中会详细介绍。
任务其实就是指某一次抓取任务或采集任务。任务与爬虫关联,其执行的也是爬虫指定的执行命令或采集规则。抓取或采集的结果与任务关联,因此可以查看到每一次任务的结果集。Crawlab的任务是整个采集流程的核心,抓取的过程都是跟任务关联起来的,因此任务对于Crawlab来说非常重要。任务被app触发,worker通过任务队列接收任务,然后在其所在节点上执行任务。
本小节将介绍以下内容:
+ + + +本小节将介绍如何使用Crawlab,包括如下内容:
+基于Celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.
- - -# 安装后台类库
-pip install -r requirements.txt
-
-# 安装前台类库
-cd frontend
-npm install
-
-请更改配置文件config.py,配置API和数据库连接.
# 启动后端API
-python app.py
-
-# 启动Flower服务
-python ./bin/run_flower.py
-
-# 启动worker
-python ./bin/run_worker.py
-
-# 运行前端
-cd frontend
-npm run serve
-
-



Crawlab的架构跟Celery非常相似,但是加入了包括前端、爬虫、Flower在内的额外模块,以支持爬虫管理的功能。
-
节点其实就是Celery中的Worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。
-在config.py文件中,修改变量PROJECT_SOURCE_FILE_FOLDER作为爬虫项目所在的目录。Crawlab后台程序会自动发现这些爬虫项目并储存到数据库中。是不是很方便?
所有爬虫需要在抓取前被部署当相应当节点中。在"爬虫详情"页面点击"Deploy"按钮,爬虫将被部署到所有有效到节点中。
-部署爬虫之后,你可以在"爬虫详情"页面点击"Run"按钮来启动爬虫。一个爬虫任务将被触发,你可以在任务列表页面中看到这个任务。
-任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。
-这是一个Flask应用,提供了必要的API来支持常规操作,例如CRUD、爬虫部署以及任务运行。每一个节点需要启动Flask应用来支持爬虫部署。运行python manage.py app或python ./bin/run_app.py来启动应用。
中间者跟Celery中定义的一样,作为运行异步任务的队列。
-前端其实就是一个基于Vue-Element-Admin的单页应用。其中重用了很多Element-UI的控件来支持相应的展示。
-任务是利用python的subprocess模块中的Popen来实现的。任务ID将以环境变量CRAWLAB_TASK_ID的形式存在于爬虫任务运行的进程中,并以此来关联抓取数据。
在你的爬虫程序中,你需要将CRAWLAB_TASK_ID的值以task_id作为可以存入数据库中。这样Crawlab就直到如何将爬虫任务与抓取数据关联起来了。当前,Crawlab只支持MongoDB。
以下是Crawlab跟Scrapy集成的例子,利用了Crawlab传过来的task_id和collection_name。
-import os
-from pymongo import MongoClient
-
-MONGO_HOST = '192.168.99.100'
-MONGO_PORT = 27017
-MONGO_DB = 'crawlab_test'
-
-# scrapy example in the pipeline
-class JuejinPipeline(object):
- mongo = MongoClient(host=MONGO_HOST, port=MONGO_PORT)
- db = mongo[MONGO_DB]
- col_name = os.environ.get('CRAWLAB_COLLECTION')
- if not col_name:
- col_name = 'test'
- col = db[col_name]
-
- def process_item(self, item, spider):
- item['task_id'] = os.environ.get('CRAWLAB_TASK_ID')
- self.col.save(item)
- return item
-
-限制以及有一些爬虫管理框架了,因此为啥还要用Crawlab?
-因为很多现有当平台都依赖于Scrapyd,限制了爬虫的编程语言以及框架,爬虫工程师只能用scrapy和python。当然,scrapy是非常优秀的爬虫框架,但是它不能做一切事情。
-Crawlab使用起来很方便,也很通用,可以适用于几乎任何主流语言和框架。它还有一个精美的前端界面,让用户可以方便的管理和运行爬虫。
-| 框架 | -类型 | -分布式 | -前端 | -依赖于Scrapyd | -
|---|---|---|---|---|
| Crawlab | -管理平台 | -Y | -Y | -N | -
| Gerapy | -管理平台 | -Y | -Y | -Y | -
| SpiderKeeper | -管理平台 | -Y | -Y | -Y | -
| ScrapydWeb | -管理平台 | -Y | -Y | -Y | -
| Scrapyd | -网络服务 | -Y | -N | -N/A | -
Crawlab是基于Celery的分布式爬虫管理平台,可以集成任何语言和任何框架。
+项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用Crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将Crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。
+Crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。Crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。
本使用手册会帮助您解决在安装使用Crawlab遇到的任何问题。
+首先,我们来看如何安装Crawlab吧,请查看安装。
@@ -537,7 +535,7 @@ MONGO_DB = 'crawlab_test' - + @@ -548,7 +546,7 @@ MONGO_DB = 'crawlab_test' diff --git a/docs/search_index.json b/docs/search_index.json index 8673f89d..d98d5152 100644 --- a/docs/search_index.json +++ b/docs/search_index.json @@ -1 +1 @@ -{"index":{"version":"0.5.12","fields":[{"name":"title","boost":10},{"name":"keywords","boost":15},{"name":"body","boost":1}],"ref":"url","documentStore":{"store":{"./":["#","'192.168.99.100'","'crawlab_test'","'test'","(中文)","./bin/run_app.py来启动应用。","./bin/run_flower.pi","./bin/run_worker.pi","27017","=","[","[x]","]","admin的单页应用。其中重用了很多el","app.pi","app或python","cd","class","col","col_nam","col_name:","crawlab","crawlab使用起来很方便,也很通用,可以适用于几乎任何主流语言和框架。它还有一个精美的前端界面,让用户可以方便的管理和运行爬虫。","crawlab的架构跟celery非常相似,但是加入了包括前端、爬虫、flower在内的额外模块,以支持爬虫管理的功能。","db","db[col_name]","def","demo","document","element","english","exampl","frontend","gerapi","import","instal","item","item,","item['task_id']","juejinpipeline(object):","manage.pi","mongo","mongo[mongo_db]","mongo_db","mongo_host","mongo_port","mongocli","mongoclient(host=mongo_host,","mongodb","mysql数据库支持","n","n/a","npm","os","os.environ.get('crawlab_collection')","os.environ.get('crawlab_task_id')","pip","pipelin","port=mongo_port)","process_item(self,","pymongo","python","python3","r","redi","requirements.txt","return","run","scrapi","scrapyd","scrapydweb","self.col.save(item)","serv","spider):","spiderkeep","todo","ui的控件来支持相应的展示。","y","与其他框架比较","与其他框架的集成","中间者","中间者跟celery中定义的一样,作为运行异步任务的队列。","以下是crawlab跟scrapy集成的例子,利用了crawlab传过来的task_id和collection_name。","任务","任务数据统计","任务是利用python的subprocess模块中的popen来实现的。任务id将以环境变量crawlab_task_id的形式存在于爬虫任务运行的进程中,并以此来关联抓取数据。","任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。","任务详情","依赖于scrapyd","全局搜索","分布式","前端","前端其实就是一个基于vue","后台应用","后端","启动flower服务","启动worker","启动后端api","因为很多现有当平台都依赖于scrapyd,限制了爬虫的编程语言以及框架,爬虫工程师只能用scrapy和python。当然,scrapy是非常优秀的爬虫框架,但是它不能做一切事情。","在config.py文件中,修改变量project_source_file_folder作为爬虫项目所在的目录。crawlab后台程序会自动发现这些爬虫项目并储存到数据库中。是不是很方便?","在你的爬虫程序中,你需要将crawlab_task_id的值以task_id作为可以存入数据库中。这样crawlab就直到如何将爬虫任务与抓取数据关联起来了。当前,crawlab只支持mongodb。","基于celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.","多语言支持","安装","安装前台类库","安装后台类库","快速开始","截图","所有爬虫需要在抓取前被部署当相应当节点中。在\"爬虫详情\"页面点击\"deploy\"按钮,爬虫将被部署到所有有效到节点中。","抓取结果","文件管理","更多爬虫例子","架构","查看演示","框架","概览","爬虫","爬虫列表","爬虫详情","登录和用户管理","简介","管理平台","类型","网络服务","自动发现","节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口。","节点监控","表格过滤","要求","请更改配置文件config.py,配置api和数据库连接.","运行前端","运行爬虫","这是一个flask应用,提供了必要的api来支持常规操作,例如crud、爬虫部署以及任务运行。每一个节点需要启动flask应用来支持爬虫部署。运行python","部署爬虫","部署爬虫之后,你可以在\"爬虫详情\"页面点击\"run\"按钮来启动爬虫。一个爬虫任务将被触发,你可以在任务列表页面中看到这个任务。","配置","重跑任务","限制以及有一些爬虫管理框架了,因此为啥还要用crawlab?","首页"],"QuickStart/":["安装","快速开始","运行"],"QuickStart/Installation.html":["#","cd","clone","frontend","git","https://github.com/tikazyq/crawlab","instal","npm","pip","r","requirements.txt","安装","安装前台类库","安装后台类库","安装类库","最快安装crawlab的方式是克隆一份代码到本地"],"QuickStart/Run.html":["#","'/tmp'","'/users/yeqing/projects/crawlab/spiders'","'/var/crawlab'","'/var/logs/crawlab'","'127.0.0.1'","'192.168.99.100'","'asia/shanghai'","'crawlab_test'","'crawlab_test',","'database':","'http://localhost:5555/api'","'mongodb://192.168.99.100:27017/'","'redis://192.168.99.100:6379/0'","'taskmeta_collection':","'tasks_celery',","27017","8000","=","app","app,可以直接启动,或者用gunicorn代替。","broker_url","cd","celeri","celery_enable_utc","celery_mongodb_backend_set","celery_result_backend","celery_timezon","celery后台url","databas","debug","flask","flask_host","flask_port","flower","flower_api_endpoint","flower服务地址","frontend","manage.pi","mongo_db","mongo_host","mongo_port","npm","project","project_deploy_file_fold","project_logs_fold","project_source_file_fold","project_tmp_fold","python","run","serv","true","variabl","worker","{","}","中间者url,连接redi","临时文件目录","启动前端服务器。","启动后端api,也就是一个flask","启动本地worker。在其他节点中如果想只是想执行任务的话,只需要启动这一个服务就可以了。","在运行之前需要对crawlab进行一些配置,配置文件为config.py。","日志目录","爬虫源码根目录","爬虫部署根目录","运行"],"Concept/":["概念"],"Concept/Node.html":["节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口。"],"Concept/Spider.html":["在config.py文件中,修改变量project_source_file_folder作为爬虫项目所在的目录。crawlab后台程序会自动发现这些爬虫项目并储存到数据库中。是不是很方便?","所有爬虫需要在抓取前被部署当相应当节点中。在\"爬虫详情\"页面点击\"deploy\"按钮,爬虫将被部署到所有有效到节点中。","爬虫","自动发现","运行爬虫","部署爬虫","部署爬虫之后,你可以在\"爬虫详情\"页面点击\"run\"按钮来启动爬虫。一个爬虫任务将被触发,你可以在任务列表页面中看到这个任务。"],"Concept/Task.html":["任务","任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。"],"Concept/Deploy.html":["所有爬虫在运行前需要被部署当相应当节点中。","部署","部署时,爬虫会被打包到相应的目录中,方便环境隔离,开发环境的爬虫和生产环境的爬虫需要打包部署来实现隔离。"],"Architecture/":["架构"],"Architecture/Celery.html":["celeri"],"Architecture/App.html":["app"],"Examples/":["exampl"]},"length":13},"tokenStore":{"root":{"2":{"7":{"0":{"1":{"7":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"8":{"0":{"0":{"0":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}},"docs":{}},"docs":{}},"docs":{}},"docs":{},"#":{"docs":{"./":{"ref":"./","tf":0.03571428571428571},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.1111111111111111},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.12121212121212122}}},"'":{"1":{"2":{"7":{"docs":{},".":{"0":{"docs":{},".":{"0":{"docs":{},".":{"1":{"docs":{},"'":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}},"docs":{}}},"docs":{}}},"docs":{}}},"docs":{}},"9":{"2":{"docs":{},".":{"1":{"6":{"8":{"docs":{},".":{"9":{"9":{"docs":{},".":{"1":{"0":{"0":{"docs":{},"'":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{},"'":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}},",":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{},"'":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"m":{"docs":{},"e":{"docs":{},"t":{"docs":{},"a":{"docs":{},"_":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"l":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"'":{"docs":{},":":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}}}},"s":{"docs":{},"_":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"'":{"docs":{},",":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}},"/":{"docs":{},"t":{"docs":{},"m":{"docs":{},"p":{"docs":{},"'":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}},"u":{"docs":{},"s":{"docs":{},"e":{"docs":{},"r":{"docs":{},"s":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"s":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"s":{"docs":{},"p":{"docs":{},"i":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{},"s":{"docs":{},"'":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"v":{"docs":{},"a":{"docs":{},"r":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"'":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}},"l":{"docs":{},"o":{"docs":{},"g":{"docs":{},"s":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"'":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}}}}},"a":{"docs":{},"s":{"docs":{},"i":{"docs":{},"a":{"docs":{},"/":{"docs":{},"s":{"docs":{},"h":{"docs":{},"a":{"docs":{},"n":{"docs":{},"g":{"docs":{},"h":{"docs":{},"a":{"docs":{},"i":{"docs":{},"'":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}},"d":{"docs":{},"a":{"docs":{},"t":{"docs":{},"a":{"docs":{},"b":{"docs":{},"a":{"docs":{},"s":{"docs":{},"e":{"docs":{},"'":{"docs":{},":":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"5":{"5":{"5":{"5":{"docs":{},"/":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"'":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"1":{"9":{"2":{"docs":{},".":{"1":{"6":{"8":{"docs":{},".":{"9":{"9":{"docs":{},".":{"1":{"0":{"0":{"docs":{},":":{"2":{"7":{"0":{"1":{"7":{"docs":{},"/":{"docs":{},"'":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"1":{"9":{"2":{"docs":{},".":{"1":{"6":{"8":{"docs":{},".":{"9":{"9":{"docs":{},".":{"1":{"0":{"0":{"docs":{},":":{"6":{"3":{"7":{"9":{"docs":{},"/":{"0":{"docs":{},"'":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}},"(":{"docs":{},"中":{"docs":{},"文":{"docs":{},")":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},".":{"docs":{},"/":{"docs":{},"b":{"docs":{},"i":{"docs":{},"n":{"docs":{},"/":{"docs":{},"r":{"docs":{},"u":{"docs":{},"n":{"docs":{},"_":{"docs":{},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"来":{"docs":{},"启":{"docs":{},"动":{"docs":{},"应":{"docs":{},"用":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}},"=":{"docs":{"./":{"ref":"./","tf":0.04591836734693878},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.16161616161616163}}},"[":{"docs":{"./":{"ref":"./","tf":0.04591836734693878}},"x":{"docs":{},"]":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}},"]":{"docs":{"./":{"ref":"./","tf":0.04591836734693878}}},"a":{"docs":{},"d":{"docs":{},"m":{"docs":{},"i":{"docs":{},"n":{"docs":{},"的":{"docs":{},"单":{"docs":{},"页":{"docs":{},"应":{"docs":{},"用":{"docs":{},"。":{"docs":{},"其":{"docs":{},"中":{"docs":{},"重":{"docs":{},"用":{"docs":{},"了":{"docs":{},"很":{"docs":{},"多":{"docs":{},"e":{"docs":{},"l":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}},"p":{"docs":{},"p":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102},"Architecture/App.html":{"ref":"Architecture/App.html","tf":11}},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}},"或":{"docs":{},"p":{"docs":{},"y":{"docs":{},"t":{"docs":{},"h":{"docs":{},"o":{"docs":{},"n":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"直":{"docs":{},"接":{"docs":{},"启":{"docs":{},"动":{"docs":{},",":{"docs":{},"或":{"docs":{},"者":{"docs":{},"用":{"docs":{},"g":{"docs":{},"u":{"docs":{},"n":{"docs":{},"i":{"docs":{},"c":{"docs":{},"o":{"docs":{},"r":{"docs":{},"n":{"docs":{},"代":{"docs":{},"替":{"docs":{},"。":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"d":{"docs":{"./":{"ref":"./","tf":0.01020408163265306},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}},"l":{"docs":{},"a":{"docs":{},"s":{"docs":{},"s":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}},"o":{"docs":{},"n":{"docs":{},"e":{"docs":{"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555}}}}}},"o":{"docs":{},"l":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{"./":{"ref":"./","tf":0.01020408163265306}},"e":{"docs":{},":":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"./":{"ref":"./","tf":0.01020408163265306}},"使":{"docs":{},"用":{"docs":{},"起":{"docs":{},"来":{"docs":{},"很":{"docs":{},"方":{"docs":{},"便":{"docs":{},",":{"docs":{},"也":{"docs":{},"很":{"docs":{},"通":{"docs":{},"用":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"适":{"docs":{},"用":{"docs":{},"于":{"docs":{},"几":{"docs":{},"乎":{"docs":{},"任":{"docs":{},"何":{"docs":{},"主":{"docs":{},"流":{"docs":{},"语":{"docs":{},"言":{"docs":{},"和":{"docs":{},"框":{"docs":{},"架":{"docs":{},"。":{"docs":{},"它":{"docs":{},"还":{"docs":{},"有":{"docs":{},"一":{"docs":{},"个":{"docs":{},"精":{"docs":{},"美":{"docs":{},"的":{"docs":{},"前":{"docs":{},"端":{"docs":{},"界":{"docs":{},"面":{"docs":{},",":{"docs":{},"让":{"docs":{},"用":{"docs":{},"户":{"docs":{},"可":{"docs":{},"以":{"docs":{},"方":{"docs":{},"便":{"docs":{},"的":{"docs":{},"管":{"docs":{},"理":{"docs":{},"和":{"docs":{},"运":{"docs":{},"行":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"的":{"docs":{},"架":{"docs":{},"构":{"docs":{},"跟":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"非":{"docs":{},"常":{"docs":{},"相":{"docs":{},"似":{"docs":{},",":{"docs":{},"但":{"docs":{},"是":{"docs":{},"加":{"docs":{},"入":{"docs":{},"了":{"docs":{},"包":{"docs":{},"括":{"docs":{},"前":{"docs":{},"端":{"docs":{},"、":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"、":{"docs":{},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{},"在":{"docs":{},"内":{"docs":{},"的":{"docs":{},"额":{"docs":{},"外":{"docs":{},"模":{"docs":{},"块":{"docs":{},",":{"docs":{},"以":{"docs":{},"支":{"docs":{},"持":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"的":{"docs":{},"功":{"docs":{},"能":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"i":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102},"Architecture/Celery.html":{"ref":"Architecture/Celery.html","tf":11}}},"y":{"docs":{},"_":{"docs":{},"e":{"docs":{},"n":{"docs":{},"a":{"docs":{},"b":{"docs":{},"l":{"docs":{},"e":{"docs":{},"_":{"docs":{},"u":{"docs":{},"t":{"docs":{},"c":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"_":{"docs":{},"b":{"docs":{},"a":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"_":{"docs":{},"s":{"docs":{},"e":{"docs":{},"t":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}}}}}},"r":{"docs":{},"e":{"docs":{},"s":{"docs":{},"u":{"docs":{},"l":{"docs":{},"t":{"docs":{},"_":{"docs":{},"b":{"docs":{},"a":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}},"t":{"docs":{},"i":{"docs":{},"m":{"docs":{},"e":{"docs":{},"z":{"docs":{},"o":{"docs":{},"n":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}},"后":{"docs":{},"台":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}},"d":{"docs":{},"b":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}},"[":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{},"]":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}},"e":{"docs":{},"f":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}},"m":{"docs":{},"o":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"b":{"docs":{},"u":{"docs":{},"g":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}},"o":{"docs":{},"c":{"docs":{},"u":{"docs":{},"m":{"docs":{},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}},"a":{"docs":{},"t":{"docs":{},"a":{"docs":{},"b":{"docs":{},"a":{"docs":{},"s":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"m":{"docs":{},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}},"n":{"docs":{},"g":{"docs":{},"l":{"docs":{},"i":{"docs":{},"s":{"docs":{},"h":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}},"x":{"docs":{},"a":{"docs":{},"m":{"docs":{},"p":{"docs":{},"l":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Examples/":{"ref":"Examples/","tf":11}}}}}}}},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{"./":{"ref":"./","tf":0.01020408163265306},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}},"l":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}},"_":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}},"p":{"docs":{},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}},"_":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"_":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"p":{"docs":{},"o":{"docs":{},"i":{"docs":{},"n":{"docs":{},"t":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}},"服":{"docs":{},"务":{"docs":{},"地":{"docs":{},"址":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}},"g":{"docs":{},"e":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}},"i":{"docs":{},"t":{"docs":{"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555}}}}},"i":{"docs":{},"m":{"docs":{},"p":{"docs":{},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{"./":{"ref":"./","tf":0.01020408163265306}}}}}}},"n":{"docs":{},"s":{"docs":{},"t":{"docs":{},"a":{"docs":{},"l":{"docs":{"./":{"ref":"./","tf":0.01020408163265306},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.1111111111111111}}}}}}},"t":{"docs":{},"e":{"docs":{},"m":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}},",":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}},"[":{"docs":{},"'":{"docs":{},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"'":{"docs":{},"]":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}},"j":{"docs":{},"u":{"docs":{},"e":{"docs":{},"j":{"docs":{},"i":{"docs":{},"n":{"docs":{},"p":{"docs":{},"i":{"docs":{},"p":{"docs":{},"e":{"docs":{},"l":{"docs":{},"i":{"docs":{},"n":{"docs":{},"e":{"docs":{},"(":{"docs":{},"o":{"docs":{},"b":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},")":{"docs":{},":":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}},"m":{"docs":{},"a":{"docs":{},"n":{"docs":{},"a":{"docs":{},"g":{"docs":{},"e":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.020202020202020204}}}}}}}}}},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}},"[":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"_":{"docs":{},"d":{"docs":{},"b":{"docs":{},"]":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}},"_":{"docs":{},"d":{"docs":{},"b":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}},"p":{"docs":{},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}},"c":{"docs":{},"l":{"docs":{},"i":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{},"(":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},"=":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"_":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},",":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}},"d":{"docs":{},"b":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}},"y":{"docs":{},"s":{"docs":{},"q":{"docs":{},"l":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"支":{"docs":{},"持":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}},"n":{"docs":{"./":{"ref":"./","tf":0.01020408163265306}},"/":{"docs":{},"a":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"p":{"docs":{},"m":{"docs":{"./":{"ref":"./","tf":0.01020408163265306},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}},"o":{"docs":{},"s":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},"i":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},".":{"docs":{},"g":{"docs":{},"e":{"docs":{},"t":{"docs":{},"(":{"docs":{},"'":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"l":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"'":{"docs":{},")":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"'":{"docs":{},")":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"p":{"docs":{},"i":{"docs":{},"p":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555}},"e":{"docs":{},"l":{"docs":{},"i":{"docs":{},"n":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{},"=":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"_":{"docs":{},"p":{"docs":{},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{},")":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}},"r":{"docs":{},"o":{"docs":{},"c":{"docs":{},"e":{"docs":{},"s":{"docs":{},"s":{"docs":{},"_":{"docs":{},"i":{"docs":{},"t":{"docs":{},"e":{"docs":{},"m":{"docs":{},"(":{"docs":{},"s":{"docs":{},"e":{"docs":{},"l":{"docs":{},"f":{"docs":{},",":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}},"_":{"docs":{},"d":{"docs":{},"e":{"docs":{},"p":{"docs":{},"l":{"docs":{},"o":{"docs":{},"y":{"docs":{},"_":{"docs":{},"f":{"docs":{},"i":{"docs":{},"l":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}}},"l":{"docs":{},"o":{"docs":{},"g":{"docs":{},"s":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}},"s":{"docs":{},"o":{"docs":{},"u":{"docs":{},"r":{"docs":{},"c":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"i":{"docs":{},"l":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}}},"t":{"docs":{},"m":{"docs":{},"p":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}},"y":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}},"t":{"docs":{},"h":{"docs":{},"o":{"docs":{},"n":{"3":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}},"docs":{"./":{"ref":"./","tf":0.015306122448979591},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.020202020202020204}}}}}}}},"r":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555}},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"q":{"docs":{},"u":{"docs":{},"i":{"docs":{},"r":{"docs":{},"e":{"docs":{},"m":{"docs":{},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{},"s":{"docs":{},".":{"docs":{},"t":{"docs":{},"x":{"docs":{},"t":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555}}}}}}}}}}}}}}}},"t":{"docs":{},"u":{"docs":{},"r":{"docs":{},"n":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}},"u":{"docs":{},"n":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{"./":{"ref":"./","tf":0.01020408163265306}}},"y":{"docs":{},"d":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}},"e":{"docs":{},"l":{"docs":{},"f":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},".":{"docs":{},"s":{"docs":{},"a":{"docs":{},"v":{"docs":{},"e":{"docs":{},"(":{"docs":{},"i":{"docs":{},"t":{"docs":{},"e":{"docs":{},"m":{"docs":{},")":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}},"r":{"docs":{},"v":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}},"p":{"docs":{},"i":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{},")":{"docs":{},":":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"k":{"docs":{},"e":{"docs":{},"e":{"docs":{},"p":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}},"t":{"docs":{},"o":{"docs":{},"d":{"docs":{},"o":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}},"r":{"docs":{},"u":{"docs":{},"e":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.020202020202020204}}}}}},"u":{"docs":{},"i":{"docs":{},"的":{"docs":{},"控":{"docs":{},"件":{"docs":{},"来":{"docs":{},"支":{"docs":{},"持":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"展":{"docs":{},"示":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}},"y":{"docs":{"./":{"ref":"./","tf":0.061224489795918366}}},"与":{"docs":{},"其":{"docs":{},"他":{"docs":{},"框":{"docs":{},"架":{"docs":{},"比":{"docs":{},"较":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"的":{"docs":{},"集":{"docs":{},"成":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}},"中":{"docs":{},"间":{"docs":{},"者":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}},"跟":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"中":{"docs":{},"定":{"docs":{},"义":{"docs":{},"的":{"docs":{},"一":{"docs":{},"样":{"docs":{},",":{"docs":{},"作":{"docs":{},"为":{"docs":{},"运":{"docs":{},"行":{"docs":{},"异":{"docs":{},"步":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"队":{"docs":{},"列":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},",":{"docs":{},"连":{"docs":{},"接":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}},"以":{"docs":{},"下":{"docs":{},"是":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"跟":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"集":{"docs":{},"成":{"docs":{},"的":{"docs":{},"例":{"docs":{},"子":{"docs":{},",":{"docs":{},"利":{"docs":{},"用":{"docs":{},"了":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"传":{"docs":{},"过":{"docs":{},"来":{"docs":{},"的":{"docs":{},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"和":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"l":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"任":{"docs":{},"务":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Task.html":{"ref":"Concept/Task.html","tf":10.5}},"数":{"docs":{},"据":{"docs":{},"统":{"docs":{},"计":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"是":{"docs":{},"利":{"docs":{},"用":{"docs":{},"p":{"docs":{},"y":{"docs":{},"t":{"docs":{},"h":{"docs":{},"o":{"docs":{},"n":{"docs":{},"的":{"docs":{},"s":{"docs":{},"u":{"docs":{},"b":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"c":{"docs":{},"e":{"docs":{},"s":{"docs":{},"s":{"docs":{},"模":{"docs":{},"块":{"docs":{},"中":{"docs":{},"的":{"docs":{},"p":{"docs":{},"o":{"docs":{},"p":{"docs":{},"e":{"docs":{},"n":{"docs":{},"来":{"docs":{},"实":{"docs":{},"现":{"docs":{},"的":{"docs":{},"。":{"docs":{},"任":{"docs":{},"务":{"docs":{},"i":{"docs":{},"d":{"docs":{},"将":{"docs":{},"以":{"docs":{},"环":{"docs":{},"境":{"docs":{},"变":{"docs":{},"量":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"的":{"docs":{},"形":{"docs":{},"式":{"docs":{},"存":{"docs":{},"在":{"docs":{},"于":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"任":{"docs":{},"务":{"docs":{},"运":{"docs":{},"行":{"docs":{},"的":{"docs":{},"进":{"docs":{},"程":{"docs":{},"中":{"docs":{},",":{"docs":{},"并":{"docs":{},"以":{"docs":{},"此":{"docs":{},"来":{"docs":{},"关":{"docs":{},"联":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"数":{"docs":{},"据":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"被":{"docs":{},"触":{"docs":{},"发":{"docs":{},"并":{"docs":{},"被":{"docs":{},"节":{"docs":{},"点":{"docs":{},"执":{"docs":{},"行":{"docs":{},"。":{"docs":{},"用":{"docs":{},"户":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"面":{"docs":{},"中":{"docs":{},"看":{"docs":{},"到":{"docs":{},"任":{"docs":{},"务":{"docs":{},"到":{"docs":{},"状":{"docs":{},"态":{"docs":{},"、":{"docs":{},"日":{"docs":{},"志":{"docs":{},"和":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"结":{"docs":{},"果":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Task.html":{"ref":"Concept/Task.html","tf":0.5}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"详":{"docs":{},"情":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"依":{"docs":{},"赖":{"docs":{},"于":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"d":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}},"全":{"docs":{},"局":{"docs":{},"搜":{"docs":{},"索":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}},"前":{"docs":{},"端":{"docs":{"./":{"ref":"./","tf":0.015306122448979591}},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"一":{"docs":{},"个":{"docs":{},"基":{"docs":{},"于":{"docs":{},"v":{"docs":{},"u":{"docs":{},"e":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}},"后":{"docs":{},"台":{"docs":{},"应":{"docs":{},"用":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}},"端":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"启":{"docs":{},"动":{"docs":{},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{},"服":{"docs":{},"务":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}},"后":{"docs":{},"端":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"一":{"docs":{},"个":{"docs":{},"f":{"docs":{},"l":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}}},"前":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"器":{"docs":{},"。":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}},"本":{"docs":{},"地":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"。":{"docs":{},"在":{"docs":{},"其":{"docs":{},"他":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},"如":{"docs":{},"果":{"docs":{},"想":{"docs":{},"只":{"docs":{},"是":{"docs":{},"想":{"docs":{},"执":{"docs":{},"行":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"话":{"docs":{},",":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"启":{"docs":{},"动":{"docs":{},"这":{"docs":{},"一":{"docs":{},"个":{"docs":{},"服":{"docs":{},"务":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"了":{"docs":{},"。":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"因":{"docs":{},"为":{"docs":{},"很":{"docs":{},"多":{"docs":{},"现":{"docs":{},"有":{"docs":{},"当":{"docs":{},"平":{"docs":{},"台":{"docs":{},"都":{"docs":{},"依":{"docs":{},"赖":{"docs":{},"于":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"d":{"docs":{},",":{"docs":{},"限":{"docs":{},"制":{"docs":{},"了":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"编":{"docs":{},"程":{"docs":{},"语":{"docs":{},"言":{"docs":{},"以":{"docs":{},"及":{"docs":{},"框":{"docs":{},"架":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"工":{"docs":{},"程":{"docs":{},"师":{"docs":{},"只":{"docs":{},"能":{"docs":{},"用":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"和":{"docs":{},"p":{"docs":{},"y":{"docs":{},"t":{"docs":{},"h":{"docs":{},"o":{"docs":{},"n":{"docs":{},"。":{"docs":{},"当":{"docs":{},"然":{"docs":{},",":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"是":{"docs":{},"非":{"docs":{},"常":{"docs":{},"优":{"docs":{},"秀":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"框":{"docs":{},"架":{"docs":{},",":{"docs":{},"但":{"docs":{},"是":{"docs":{},"它":{"docs":{},"不":{"docs":{},"能":{"docs":{},"做":{"docs":{},"一":{"docs":{},"切":{"docs":{},"事":{"docs":{},"情":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"在":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"文":{"docs":{},"件":{"docs":{},"中":{"docs":{},",":{"docs":{},"修":{"docs":{},"改":{"docs":{},"变":{"docs":{},"量":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"_":{"docs":{},"s":{"docs":{},"o":{"docs":{},"u":{"docs":{},"r":{"docs":{},"c":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"i":{"docs":{},"l":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{},"作":{"docs":{},"为":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"所":{"docs":{},"在":{"docs":{},"的":{"docs":{},"目":{"docs":{},"录":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"后":{"docs":{},"台":{"docs":{},"程":{"docs":{},"序":{"docs":{},"会":{"docs":{},"自":{"docs":{},"动":{"docs":{},"发":{"docs":{},"现":{"docs":{},"这":{"docs":{},"些":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"并":{"docs":{},"储":{"docs":{},"存":{"docs":{},"到":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"中":{"docs":{},"。":{"docs":{},"是":{"docs":{},"不":{"docs":{},"是":{"docs":{},"很":{"docs":{},"方":{"docs":{},"便":{"docs":{},"?":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Spider.html":{"ref":"Concept/Spider.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"你":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"程":{"docs":{},"序":{"docs":{},"中":{"docs":{},",":{"docs":{},"你":{"docs":{},"需":{"docs":{},"要":{"docs":{},"将":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"的":{"docs":{},"值":{"docs":{},"以":{"docs":{},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"作":{"docs":{},"为":{"docs":{},"可":{"docs":{},"以":{"docs":{},"存":{"docs":{},"入":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"中":{"docs":{},"。":{"docs":{},"这":{"docs":{},"样":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"就":{"docs":{},"直":{"docs":{},"到":{"docs":{},"如":{"docs":{},"何":{"docs":{},"将":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"任":{"docs":{},"务":{"docs":{},"与":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"数":{"docs":{},"据":{"docs":{},"关":{"docs":{},"联":{"docs":{},"起":{"docs":{},"来":{"docs":{},"了":{"docs":{},"。":{"docs":{},"当":{"docs":{},"前":{"docs":{},",":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"只":{"docs":{},"支":{"docs":{},"持":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"运":{"docs":{},"行":{"docs":{},"之":{"docs":{},"前":{"docs":{},"需":{"docs":{},"要":{"docs":{},"对":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"进":{"docs":{},"行":{"docs":{},"一":{"docs":{},"些":{"docs":{},"配":{"docs":{},"置":{"docs":{},",":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"为":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"。":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"基":{"docs":{},"于":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"平":{"docs":{},"台":{"docs":{},",":{"docs":{},"支":{"docs":{},"持":{"docs":{},"多":{"docs":{},"种":{"docs":{},"编":{"docs":{},"程":{"docs":{},"语":{"docs":{},"言":{"docs":{},"以":{"docs":{},"及":{"docs":{},"多":{"docs":{},"种":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"框":{"docs":{},"架":{"docs":{},".":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"多":{"docs":{},"语":{"docs":{},"言":{"docs":{},"支":{"docs":{},"持":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}},"安":{"docs":{},"装":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/":{"ref":"QuickStart/","tf":0.3333333333333333},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":10.055555555555555}},"前":{"docs":{},"台":{"docs":{},"类":{"docs":{},"库":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555}}}}}},"后":{"docs":{},"台":{"docs":{},"类":{"docs":{},"库":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555}}}}}},"类":{"docs":{},"库":{"docs":{"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555}}}}}},"快":{"docs":{},"速":{"docs":{},"开":{"docs":{},"始":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"QuickStart/":{"ref":"QuickStart/","tf":10.333333333333334}}}}}},"截":{"docs":{},"图":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"需":{"docs":{},"要":{"docs":{},"在":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"前":{"docs":{},"被":{"docs":{},"部":{"docs":{},"署":{"docs":{},"当":{"docs":{},"相":{"docs":{},"应":{"docs":{},"当":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},"。":{"docs":{},"在":{"docs":{},"\"":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"\"":{"docs":{},"页":{"docs":{},"面":{"docs":{},"点":{"docs":{},"击":{"docs":{},"\"":{"docs":{},"d":{"docs":{},"e":{"docs":{},"p":{"docs":{},"l":{"docs":{},"o":{"docs":{},"y":{"docs":{},"\"":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"将":{"docs":{},"被":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"所":{"docs":{},"有":{"docs":{},"有":{"docs":{},"效":{"docs":{},"到":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Spider.html":{"ref":"Concept/Spider.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"在":{"docs":{},"运":{"docs":{},"行":{"docs":{},"前":{"docs":{},"需":{"docs":{},"要":{"docs":{},"被":{"docs":{},"部":{"docs":{},"署":{"docs":{},"当":{"docs":{},"相":{"docs":{},"应":{"docs":{},"当":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},"。":{"docs":{"Concept/Deploy.html":{"ref":"Concept/Deploy.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}},"抓":{"docs":{},"取":{"docs":{},"结":{"docs":{},"果":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"文":{"docs":{},"件":{"docs":{},"管":{"docs":{},"理":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"更":{"docs":{},"多":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"例":{"docs":{},"子":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}},"架":{"docs":{},"构":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Architecture/":{"ref":"Architecture/","tf":11}}}},"查":{"docs":{},"看":{"docs":{},"演":{"docs":{},"示":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"框":{"docs":{},"架":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"概":{"docs":{},"览":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}},"念":{"docs":{"Concept/":{"ref":"Concept/","tf":11}}}},"爬":{"docs":{},"虫":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Spider.html":{"ref":"Concept/Spider.html","tf":10.142857142857142}},"列":{"docs":{},"表":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"详":{"docs":{},"情":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"源":{"docs":{},"码":{"docs":{},"根":{"docs":{},"目":{"docs":{},"录":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}},"部":{"docs":{},"署":{"docs":{},"根":{"docs":{},"目":{"docs":{},"录":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}},"登":{"docs":{},"录":{"docs":{},"和":{"docs":{},"用":{"docs":{},"户":{"docs":{},"管":{"docs":{},"理":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}},"简":{"docs":{},"介":{"docs":{"./":{"ref":"./","tf":10}}}},"管":{"docs":{},"理":{"docs":{},"平":{"docs":{},"台":{"docs":{"./":{"ref":"./","tf":0.02040816326530612}}}}}},"类":{"docs":{},"型":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"网":{"docs":{},"络":{"docs":{},"服":{"docs":{},"务":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"自":{"docs":{},"动":{"docs":{},"发":{"docs":{},"现":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Spider.html":{"ref":"Concept/Spider.html","tf":0.14285714285714285}}}}}},"节":{"docs":{},"点":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Node.html":{"ref":"Concept/Node.html","tf":10.5}},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"中":{"docs":{},"的":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"。":{"docs":{},"一":{"docs":{},"个":{"docs":{},"节":{"docs":{},"点":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"会":{"docs":{},"连":{"docs":{},"接":{"docs":{},"到":{"docs":{},"一":{"docs":{},"个":{"docs":{},"任":{"docs":{},"务":{"docs":{},"队":{"docs":{},"列":{"docs":{},"(":{"docs":{},"例":{"docs":{},"如":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},")":{"docs":{},"来":{"docs":{},"接":{"docs":{},"收":{"docs":{},"和":{"docs":{},"运":{"docs":{},"行":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"需":{"docs":{},"要":{"docs":{},"在":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"被":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},",":{"docs":{},"用":{"docs":{},"户":{"docs":{},"在":{"docs":{},"部":{"docs":{},"署":{"docs":{},"前":{"docs":{},"需":{"docs":{},"要":{"docs":{},"定":{"docs":{},"义":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},"和":{"docs":{},"端":{"docs":{},"口":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Node.html":{"ref":"Concept/Node.html","tf":0.5}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"监":{"docs":{},"控":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"表":{"docs":{},"格":{"docs":{},"过":{"docs":{},"滤":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"要":{"docs":{},"求":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"请":{"docs":{},"更":{"docs":{},"改":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},",":{"docs":{},"配":{"docs":{},"置":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"和":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"连":{"docs":{},"接":{"docs":{},".":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"运":{"docs":{},"行":{"docs":{"QuickStart/":{"ref":"QuickStart/","tf":0.3333333333333333},"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":10.01010101010101}},"前":{"docs":{},"端":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"爬":{"docs":{},"虫":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Spider.html":{"ref":"Concept/Spider.html","tf":0.14285714285714285}}}}}},"这":{"docs":{},"是":{"docs":{},"一":{"docs":{},"个":{"docs":{},"f":{"docs":{},"l":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"应":{"docs":{},"用":{"docs":{},",":{"docs":{},"提":{"docs":{},"供":{"docs":{},"了":{"docs":{},"必":{"docs":{},"要":{"docs":{},"的":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"来":{"docs":{},"支":{"docs":{},"持":{"docs":{},"常":{"docs":{},"规":{"docs":{},"操":{"docs":{},"作":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"c":{"docs":{},"r":{"docs":{},"u":{"docs":{},"d":{"docs":{},"、":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"以":{"docs":{},"及":{"docs":{},"任":{"docs":{},"务":{"docs":{},"运":{"docs":{},"行":{"docs":{},"。":{"docs":{},"每":{"docs":{},"一":{"docs":{},"个":{"docs":{},"节":{"docs":{},"点":{"docs":{},"需":{"docs":{},"要":{"docs":{},"启":{"docs":{},"动":{"docs":{},"f":{"docs":{},"l":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"应":{"docs":{},"用":{"docs":{},"来":{"docs":{},"支":{"docs":{},"持":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"。":{"docs":{},"运":{"docs":{},"行":{"docs":{},"p":{"docs":{},"y":{"docs":{},"t":{"docs":{},"h":{"docs":{},"o":{"docs":{},"n":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"部":{"docs":{},"署":{"docs":{"Concept/Deploy.html":{"ref":"Concept/Deploy.html","tf":10.333333333333334}},"爬":{"docs":{},"虫":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Spider.html":{"ref":"Concept/Spider.html","tf":0.14285714285714285}},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"你":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"\"":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"\"":{"docs":{},"页":{"docs":{},"面":{"docs":{},"点":{"docs":{},"击":{"docs":{},"\"":{"docs":{},"r":{"docs":{},"u":{"docs":{},"n":{"docs":{},"\"":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"来":{"docs":{},"启":{"docs":{},"动":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"。":{"docs":{},"一":{"docs":{},"个":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"任":{"docs":{},"务":{"docs":{},"将":{"docs":{},"被":{"docs":{},"触":{"docs":{},"发":{"docs":{},",":{"docs":{},"你":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"任":{"docs":{},"务":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},"面":{"docs":{},"中":{"docs":{},"看":{"docs":{},"到":{"docs":{},"这":{"docs":{},"个":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.00510204081632653},"Concept/Spider.html":{"ref":"Concept/Spider.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"时":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"会":{"docs":{},"被":{"docs":{},"打":{"docs":{},"包":{"docs":{},"到":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"目":{"docs":{},"录":{"docs":{},"中":{"docs":{},",":{"docs":{},"方":{"docs":{},"便":{"docs":{},"环":{"docs":{},"境":{"docs":{},"隔":{"docs":{},"离":{"docs":{},",":{"docs":{},"开":{"docs":{},"发":{"docs":{},"环":{"docs":{},"境":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"和":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"需":{"docs":{},"要":{"docs":{},"打":{"docs":{},"包":{"docs":{},"部":{"docs":{},"署":{"docs":{},"来":{"docs":{},"实":{"docs":{},"现":{"docs":{},"隔":{"docs":{},"离":{"docs":{},"。":{"docs":{"Concept/Deploy.html":{"ref":"Concept/Deploy.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"配":{"docs":{},"置":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"重":{"docs":{},"跑":{"docs":{},"任":{"docs":{},"务":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}},"限":{"docs":{},"制":{"docs":{},"以":{"docs":{},"及":{"docs":{},"有":{"docs":{},"一":{"docs":{},"些":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"框":{"docs":{},"架":{"docs":{},"了":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"为":{"docs":{},"啥":{"docs":{},"还":{"docs":{},"要":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"?":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"首":{"docs":{},"页":{"docs":{"./":{"ref":"./","tf":0.00510204081632653}}}},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},"s":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"g":{"docs":{},"i":{"docs":{},"t":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"m":{"docs":{},"/":{"docs":{},"t":{"docs":{},"i":{"docs":{},"k":{"docs":{},"a":{"docs":{},"z":{"docs":{},"y":{"docs":{},"q":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"最":{"docs":{},"快":{"docs":{},"安":{"docs":{},"装":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"是":{"docs":{},"克":{"docs":{},"隆":{"docs":{},"一":{"docs":{},"份":{"docs":{},"代":{"docs":{},"码":{"docs":{},"到":{"docs":{},"本":{"docs":{},"地":{"docs":{"QuickStart/Installation.html":{"ref":"QuickStart/Installation.html","tf":0.05555555555555555}}}}}}}}}}}}}}}}}}}}}}}}}},"b":{"docs":{},"r":{"docs":{},"o":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"_":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}}}}}},"v":{"docs":{},"a":{"docs":{},"r":{"docs":{},"i":{"docs":{},"a":{"docs":{},"b":{"docs":{},"l":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.050505050505050504}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}},"{":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}},"}":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}},"临":{"docs":{},"时":{"docs":{},"文":{"docs":{},"件":{"docs":{},"目":{"docs":{},"录":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}}},"日":{"docs":{},"志":{"docs":{},"目":{"docs":{},"录":{"docs":{"QuickStart/Run.html":{"ref":"QuickStart/Run.html","tf":0.010101010101010102}}}}}}},"length":244},"corpusTokens":["#","'/tmp'","'/users/yeqing/projects/crawlab/spiders'","'/var/crawlab'","'/var/logs/crawlab'","'127.0.0.1'","'192.168.99.100'","'asia/shanghai'","'crawlab_test'","'crawlab_test',","'database':","'http://localhost:5555/api'","'mongodb://192.168.99.100:27017/'","'redis://192.168.99.100:6379/0'","'taskmeta_collection':","'tasks_celery',","'test'","(中文)","./bin/run_app.py来启动应用。","./bin/run_flower.pi","./bin/run_worker.pi","27017","8000","=","[","[x]","]","admin的单页应用。其中重用了很多el","app","app.pi","app或python","app,可以直接启动,或者用gunicorn代替。","broker_url","cd","celeri","celery_enable_utc","celery_mongodb_backend_set","celery_result_backend","celery_timezon","celery后台url","class","clone","col","col_nam","col_name:","crawlab","crawlab使用起来很方便,也很通用,可以适用于几乎任何主流语言和框架。它还有一个精美的前端界面,让用户可以方便的管理和运行爬虫。","crawlab的架构跟celery非常相似,但是加入了包括前端、爬虫、flower在内的额外模块,以支持爬虫管理的功能。","databas","db","db[col_name]","debug","def","demo","document","element","english","exampl","flask","flask_host","flask_port","flower","flower_api_endpoint","flower服务地址","frontend","gerapi","git","https://github.com/tikazyq/crawlab","import","instal","item","item,","item['task_id']","juejinpipeline(object):","manage.pi","mongo","mongo[mongo_db]","mongo_db","mongo_host","mongo_port","mongocli","mongoclient(host=mongo_host,","mongodb","mysql数据库支持","n","n/a","npm","os","os.environ.get('crawlab_collection')","os.environ.get('crawlab_task_id')","pip","pipelin","port=mongo_port)","process_item(self,","project","project_deploy_file_fold","project_logs_fold","project_source_file_fold","project_tmp_fold","pymongo","python","python3","r","redi","requirements.txt","return","run","scrapi","scrapyd","scrapydweb","self.col.save(item)","serv","spider):","spiderkeep","todo","true","ui的控件来支持相应的展示。","variabl","worker","y","{","}","与其他框架比较","与其他框架的集成","中间者","中间者url,连接redi","中间者跟celery中定义的一样,作为运行异步任务的队列。","临时文件目录","以下是crawlab跟scrapy集成的例子,利用了crawlab传过来的task_id和collection_name。","任务","任务数据统计","任务是利用python的subprocess模块中的popen来实现的。任务id将以环境变量crawlab_task_id的形式存在于爬虫任务运行的进程中,并以此来关联抓取数据。","任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。","任务详情","依赖于scrapyd","全局搜索","分布式","前端","前端其实就是一个基于vue","后台应用","后端","启动flower服务","启动worker","启动前端服务器。","启动后端api","启动后端api,也就是一个flask","启动本地worker。在其他节点中如果想只是想执行任务的话,只需要启动这一个服务就可以了。","因为很多现有当平台都依赖于scrapyd,限制了爬虫的编程语言以及框架,爬虫工程师只能用scrapy和python。当然,scrapy是非常优秀的爬虫框架,但是它不能做一切事情。","在config.py文件中,修改变量project_source_file_folder作为爬虫项目所在的目录。crawlab后台程序会自动发现这些爬虫项目并储存到数据库中。是不是很方便?","在你的爬虫程序中,你需要将crawlab_task_id的值以task_id作为可以存入数据库中。这样crawlab就直到如何将爬虫任务与抓取数据关联起来了。当前,crawlab只支持mongodb。","在运行之前需要对crawlab进行一些配置,配置文件为config.py。","基于celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.","多语言支持","安装","安装前台类库","安装后台类库","安装类库","快速开始","截图","所有爬虫在运行前需要被部署当相应当节点中。","所有爬虫需要在抓取前被部署当相应当节点中。在\"爬虫详情\"页面点击\"deploy\"按钮,爬虫将被部署到所有有效到节点中。","抓取结果","文件管理","日志目录","更多爬虫例子","最快安装crawlab的方式是克隆一份代码到本地","架构","查看演示","框架","概念","概览","爬虫","爬虫列表","爬虫源码根目录","爬虫详情","爬虫部署根目录","登录和用户管理","简介","管理平台","类型","网络服务","自动发现","节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口。","节点监控","表格过滤","要求","请更改配置文件config.py,配置api和数据库连接.","运行","运行前端","运行爬虫","这是一个flask应用,提供了必要的api来支持常规操作,例如crud、爬虫部署以及任务运行。每一个节点需要启动flask应用来支持爬虫部署。运行python","部署","部署时,爬虫会被打包到相应的目录中,方便环境隔离,开发环境的爬虫和生产环境的爬虫需要打包部署来实现隔离。","部署爬虫","部署爬虫之后,你可以在\"爬虫详情\"页面点击\"run\"按钮来启动爬虫。一个爬虫任务将被触发,你可以在任务列表页面中看到这个任务。","配置","重跑任务","限制以及有一些爬虫管理框架了,因此为啥还要用crawlab?","首页"],"pipeline":["stopWordFilter","stemmer"]},"store":{"./":{"url":"./","title":"简介","keywords":"","body":"Crawlab\n基于Celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.\n查看演示 Demo\nEnglish Documentation\n要求\n\nPython3\nMongoDB\nRedis\n\n安装\n# 安装后台类库\npip install -r requirements.txt\n\n# 安装前台类库\ncd frontend\nnpm install\n\n配置\n请更改配置文件config.py,配置API和数据库连接.\n快速开始\n# 启动后端API\npython app.py\n\n# 启动Flower服务\npython ./bin/run_flower.py\n\n# 启动worker\npython ./bin/run_worker.py\n\n# 运行前端\ncd frontend\nnpm run serve\n\n截图\n首页\n\n爬虫列表\n\n爬虫详情 - 概览\n\n任务详情 - 抓取结果\n\n架构\nCrawlab的架构跟Celery非常相似,但是加入了包括前端、爬虫、Flower在内的额外模块,以支持爬虫管理的功能。\n\n节点\n节点其实就是Celery中的Worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。\n爬虫\n自动发现\n在config.py文件中,修改变量PROJECT_SOURCE_FILE_FOLDER作为爬虫项目所在的目录。Crawlab后台程序会自动发现这些爬虫项目并储存到数据库中。是不是很方便?\n部署爬虫\n所有爬虫需要在抓取前被部署当相应当节点中。在\"爬虫详情\"页面点击\"Deploy\"按钮,爬虫将被部署到所有有效到节点中。\n运行爬虫\n部署爬虫之后,你可以在\"爬虫详情\"页面点击\"Run\"按钮来启动爬虫。一个爬虫任务将被触发,你可以在任务列表页面中看到这个任务。\n任务\n任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。\n后台应用\n这是一个Flask应用,提供了必要的API来支持常规操作,例如CRUD、爬虫部署以及任务运行。每一个节点需要启动Flask应用来支持爬虫部署。运行python manage.py app或python ./bin/run_app.py来启动应用。\n中间者\n中间者跟Celery中定义的一样,作为运行异步任务的队列。\n前端\n前端其实就是一个基于Vue-Element-Admin的单页应用。其中重用了很多Element-UI的控件来支持相应的展示。\n与其他框架的集成\n任务是利用python的subprocess模块中的Popen来实现的。任务ID将以环境变量CRAWLAB_TASK_ID的形式存在于爬虫任务运行的进程中,并以此来关联抓取数据。\n在你的爬虫程序中,你需要将CRAWLAB_TASK_ID的值以task_id作为可以存入数据库中。这样Crawlab就直到如何将爬虫任务与抓取数据关联起来了。当前,Crawlab只支持MongoDB。\nScrapy\n以下是Crawlab跟Scrapy集成的例子,利用了Crawlab传过来的task_id和collection_name。\nimport os\nfrom pymongo import MongoClient\n\nMONGO_HOST = '192.168.99.100'\nMONGO_PORT = 27017\nMONGO_DB = 'crawlab_test'\n\n# scrapy example in the pipeline\nclass JuejinPipeline(object):\n mongo = MongoClient(host=MONGO_HOST, port=MONGO_PORT)\n db = mongo[MONGO_DB]\n col_name = os.environ.get('CRAWLAB_COLLECTION')\n if not col_name:\n col_name = 'test'\n col = db[col_name]\n\n def process_item(self, item, spider):\n item['task_id'] = os.environ.get('CRAWLAB_TASK_ID')\n self.col.save(item)\n return item\n\n与其他框架比较\n限制以及有一些爬虫管理框架了,因此为啥还要用Crawlab?\n因为很多现有当平台都依赖于Scrapyd,限制了爬虫的编程语言以及框架,爬虫工程师只能用scrapy和python。当然,scrapy是非常优秀的爬虫框架,但是它不能做一切事情。\nCrawlab使用起来很方便,也很通用,可以适用于几乎任何主流语言和框架。它还有一个精美的前端界面,让用户可以方便的管理和运行爬虫。\n\n\n\n框架\n类型\n分布式\n前端\n依赖于Scrapyd\n\n\n\n\nCrawlab\n管理平台\nY\nY\nN\n\n\nGerapy\n管理平台\nY\nY\nY\n\n\nSpiderKeeper\n管理平台\nY\nY\nY\n\n\nScrapydWeb\n管理平台\nY\nY\nY\n\n\nScrapyd\n网络服务\nY\nN\nN/A\n\n\n\nTODOs\n后端\n\n[ ] 文件管理\n[ ] MySQL数据库支持\n[ ] 重跑任务\n[ ] 节点监控\n[ ] 更多爬虫例子\n\n前端\n\n[ ] 任务数据统计\n[ ] 表格过滤\n[x] 多语言支持 (中文)\n[ ] 登录和用户管理\n[ ] 全局搜索\n\n"},"QuickStart/":{"url":"QuickStart/","title":"快速开始","keywords":"","body":"快速开始\n\n安装\n运行\n\n"},"QuickStart/Installation.html":{"url":"QuickStart/Installation.html","title":"安装","keywords":"","body":"安装\n最快安装Crawlab的方式是克隆一份代码到本地\ngit clone https://github.com/tikazyq/crawlab\n\n安装类库\n# 安装后台类库\npip install -r requirements.txt\n\n# 安装前台类库\ncd frontend\nnpm install\n\n"},"QuickStart/Run.html":{"url":"QuickStart/Run.html","title":"运行","keywords":"","body":"运行\n在运行之前需要对Crawlab进行一些配置,配置文件为config.py。\n# project variables\nPROJECT_SOURCE_FILE_FOLDER = '/Users/yeqing/projects/crawlab/spiders' # 爬虫源码根目录\nPROJECT_DEPLOY_FILE_FOLDER = '/var/crawlab' # 爬虫部署根目录\nPROJECT_LOGS_FOLDER = '/var/logs/crawlab' # 日志目录\nPROJECT_TMP_FOLDER = '/tmp' # 临时文件目录\n\n# celery variables\nBROKER_URL = 'redis://192.168.99.100:6379/0' # 中间者URL,连接redis\nCELERY_RESULT_BACKEND = 'mongodb://192.168.99.100:27017/' # CELERY后台URL\nCELERY_MONGODB_BACKEND_SETTINGS = {\n 'database': 'crawlab_test',\n 'taskmeta_collection': 'tasks_celery',\n}\nCELERY_TIMEZONE = 'Asia/Shanghai'\nCELERY_ENABLE_UTC = True\n\n# flower variables\nFLOWER_API_ENDPOINT = 'http://localhost:5555/api' # Flower服务地址\n\n# database variables\nMONGO_HOST = '192.168.99.100'\nMONGO_PORT = 27017\nMONGO_DB = 'crawlab_test'\n\n# flask variables\nDEBUG = True\nFLASK_HOST = '127.0.0.1'\nFLASK_PORT = 8000\n\n启动后端API,也就是一个Flask App,可以直接启动,或者用gunicorn代替。\npython manage.py app\n\n启动本地Worker。在其他节点中如果想只是想执行任务的话,只需要启动这一个服务就可以了。\npython manage.py worker\n\n启动前端服务器。\ncd frontend\nnpm run serve\n\n"},"Concept/":{"url":"Concept/","title":"概念","keywords":"","body":"概念\n"},"Concept/Node.html":{"url":"Concept/Node.html","title":"节点","keywords":"","body":"节点\n节点其实就是Celery中的Worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。\n"},"Concept/Spider.html":{"url":"Concept/Spider.html","title":"爬虫","keywords":"","body":"爬虫\n自动发现\n在config.py文件中,修改变量PROJECT_SOURCE_FILE_FOLDER作为爬虫项目所在的目录。Crawlab后台程序会自动发现这些爬虫项目并储存到数据库中。是不是很方便?\n部署爬虫\n所有爬虫需要在抓取前被部署当相应当节点中。在\"爬虫详情\"页面点击\"Deploy\"按钮,爬虫将被部署到所有有效到节点中。\n运行爬虫\n部署爬虫之后,你可以在\"爬虫详情\"页面点击\"Run\"按钮来启动爬虫。一个爬虫任务将被触发,你可以在任务列表页面中看到这个任务。\n"},"Concept/Task.html":{"url":"Concept/Task.html","title":"任务","keywords":"","body":"任务\n任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。\n"},"Concept/Deploy.html":{"url":"Concept/Deploy.html","title":"部署","keywords":"","body":"部署\n所有爬虫在运行前需要被部署当相应当节点中。\n部署时,爬虫会被打包到相应的目录中,方便环境隔离,开发环境的爬虫和生产环境的爬虫需要打包部署来实现隔离。\n"},"Architecture/":{"url":"Architecture/","title":"架构","keywords":"","body":"架构\n"},"Architecture/Celery.html":{"url":"Architecture/Celery.html","title":"Celery","keywords":"","body":"Celery\n"},"Architecture/App.html":{"url":"Architecture/App.html","title":"App","keywords":"","body":"App\n"},"Examples/":{"url":"Examples/","title":"Examples","keywords":"","body":"Examples\n"}}} \ No newline at end of file +{"index":{"version":"0.5.12","fields":[{"name":"title","boost":10},{"name":"keywords","boost":15},{"name":"body","boost":1}],"ref":"url","documentStore":{"store":{"./":["crawlab","crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。","crawlab是基于celery的分布式爬虫管理平台,可以集成任何语言和任何框架。","crawlab简介","demo","基于celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.","本使用手册会帮助您解决在安装使用crawlab遇到的任何问题。","查看演示","项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。","首先,我们来看如何安装crawlab吧,请查看安装。"],"Installation/":["docker","安装crawlab","本小节将介绍三种安装docker的方式:","直接部署","预览模式"],"Installation/Docker.html":["\"27017:27017\"","\"6379:6379\"","\"8000:8000\"","\"8001:8000\"","\"8002:8000\"","\"8080:8080\"","\"registri","#","'3.3'","/bin/sh","/home/yeqing/.env.production.master:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production:/opt/crawlab/frontend/.env.product","/home/yeqing/config.master.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.pi","/opt/crawlab/docker_init.sh","27017:27017","30秒的时间来build前端静态文件,之后就可以打开crawlab界面地址地址看到界面了。界面地址默认为http://localhost:8080。","8000:8000","8080:8080","[\"https://registry.dock","\\","alway","app","cn.com\"]","compos","compose.yml后,只需要运行以下命令就可以启动crawlab。","compose.yml定义如下。","compose.yml更改为如下内容。","compose.yml的yaml文件来定义需要启动的容器,可以是单个,也可以(通常)是多个的。crawlab的dock","compose也很简单,大家去网上百度一下就可以了。","compose和定义好dock","compose是一个集群管理方式,可以利用名为dock","compose的方式很适合多节点部署,在原有的master基础上增加几个worker节点,达到多节点部署的目的。将dock","compose的方式来部署。dock","container_name:","crawlab","d","depends_on:","docker","docker安装部署","entrypoint:","image:","master","master:","mirrors\":","mongo","mongo:","mongo:latest","mongo一行命令。如何安装docker跟操作系统有关,这里就不展开讲了,需要的同学自行百度一下相关教程。","name","nginx","p","ports:","pull","redi","redis:","redis:latest","restart:","rm","run","services:","tikazyq/crawlab","tikazyq/crawlab:latest","up","v","version:","volumns:","worker","worker1:","worker2:","{","}","下载镜像","其中,我们映射了8080端口(nginx前端静态文件)以及8000端口(后端api)到宿主机。另外还将前端配置文件/home/yeqing/.env.production和后端配置文件/home/yeqing/config.py映射到了容器相应的目录下。传入参数master是代表该启动方式为主机启动模式,也就是所有服务(前端、api、flower、worker)都会启动。另外一个模式是worker模式,只会启动必要的api和worker服务,这个对于分布式部署比较有用。等待大约20","前端配置文件","同样,在浏览器中输入http://localhost:8080就可以看到界面。","后端配置文件","多节点模式","安装docker","安装完docker","对docker不了解的开发者,可以参考一下这篇文章(9102","年了,学点","当然,也可以用docker","我们已经在dockerhub上构建了crawlab的镜像,开发者只需要将其pull下来使用。在pul","执行以下命令将crawlab的镜像下载下来。镜像大小大概在几百兆,因此下载需要几分钟时间。","拷贝一份后端配置文件./crawlab/config/config.py以及前端配置文件./frontend/.env.production到某一个地方。例如我的例子,分别为/home/yeqing/config.py和/home/yeqing/.env.production。","更改后端配置文件config.py,将mongodb、redis的指向ip更改为自己数据的值。注意,容器中对应的宿主机的ip地址不是localhost,而是172.17.0.1(当然也可以用network来做,只是稍微麻烦一些)。更改前端配置文件.env.production,将api地址vue_app_base_url更改为宿主机所在的ip地址,例如http://192.168.0.8:8000,这将是前端调用api会用到的url。","更改好配置文件之后,接下来就是运行容器了。执行以下命令来启动容器。","更改配置文件","知识)做进一步了解。简单来说,docker可以利用已存在的镜像帮助构建一些常用的服务和应用,例如nginx、mongodb、redis等等。用docker运行一个mongodb服务仅需dock","运行docker容器","这应该是部署应用的最方便也是最节省时间的方式了。在最近的一次版本更新v0.2.3中,我们发布了docker功能,让大家可以利用docker来轻松部署crawlab。下面将一步一步介绍如何使用docker来部署crawlab。","这样的话,pull镜像的速度会比不改变镜像源的速度快很多。","这里先定义了master节点,也就是crawlab的主节点。master依赖于mongo和redis容器,因此在启动之前会同时启动mongo和redis容器。这样就不需要单独配置mongo和redis服务了,大大节省了环境配置的时间。","这里启动了多增加了两个worker节点,以worker模式启动。这样,多节点部署,也就是分布式部署就完成了。","镜像之前,我们需要配置一下镜像源。因为我们在墙内,使用原有的镜像源速度非常感人,因此将使用dockerhub在国内的加速器。创建/etc/docker/daemon.json文件,在其中输入如下内容。"],"Installation/Direct.html":["#","../crawlab","../frontend","/home/yeqing/jenkins_home/workspace/crawlab_develop/frontend/dist;","16.04是以下命令。","8080;","[app]","api服务","app.pi","apt","build:prod","cd","clone","dev.crawlab.com;","flower","flower.pi","frontend","g","git","https://github.com/tikazyq/crawlab","index","index.html;","instal","listen","log","nginx","npm","pip","pm2","r","reload","requir","root","run","server","server_nam","start","sudo","worker","worker.pi","yarn","{","}","其中,root是静态文件的根目录,这里是npm打包好后的静态文件。","分别配置前端配置文件./frontend/.env.production和后端配置文件./crawlab/config/config.py。分别需要对部署后api地址以及数据库地址进行配置。","启动服务","安装","安装nginx,在ubuntu","安装前端所需库。","安装后端所需库。","拉取代码","构建","构建完成后,会在./frontend目录下创建一个dist文件夹,里面是打包好后的静态文件。","添加/etc/nginx/conf.d/crawlab.conf文件,输入以下内容。","然后在浏览器中输入http://localhost:8080就可以看到界面了。","现在,只需要启动nginx服务就完成了启动前端服务。","直接部署","直接部署是之前没有docker时的部署方式,相对于docker部署来说有些繁琐。但了解如何直接部署可以帮助更深入地理解docker是如何构建crawlab镜像的。这里简单介绍一下。","这样,pm2会启动3个守护进程来管理这3个服务。我们如果想看后端服务的日志的话,可以执行以下命令。","这里是指启动后端服务。我们用pm2来管理进程。执行以下命令。","这里的构建是指前端构建,需要执行以下命令。","配置","首先是将github上的代码拉取到本地。"],"Installation/Preview.html":["manage.pi","python","run","serv","serve来进行的,因此是开发者模式。注意:强烈不建议在生产环境中用预览模式。预览模式只是让开发者快速体验crawlab以及调试代码问题的一种方式,而不是用作生产环境部署的。","该模式同样会启动3个后端服务和1个前端服务。前端服务是通过npm","预览模式","预览模式是一种让用户比较快的上手的一种部署模式。跟直接部署类似,但不用经过构建、nginx和启动服务的步骤。在启动时只需要执行以下命令就可以了。相较于直接部署来说方便一些。"],"Usage/":["任务","使用crawlab","定时任务","本小节将介绍如何使用crawlab,包括如下内容:","爬虫","节点"],"Usage/Node/":["修改节点信息","查看节点","节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口(默认为localhost:8000)。"],"Usage/Node/View.html":["worker,他们通过连接到配置好的broker(通常是redis)来进行与主机的通信。","查看节点列表","点击侧边栏的节点导航至节点列表,可以看到已上线的节点。这里的节点其实就是已经运行起来的celeri"],"Usage/Node/Edit.html":["修改节点信息","后面我们需要让爬虫运行在各个节点上,需要让主机与节点进行通信,因此需要知道节点的ip地址和端口。我们需要手动配置一下节点的ip和端口。在节点列表中点击操作列里的蓝色查看按钮进入到节点详情。节点详情样子如下。","在右侧分别输入该节点对应的节点ip和节点端口,然后点击保存按钮,保存该节点信息。","这样,我们就完成了节点的配置工作。"],"Usage/Spider/":["创建爬虫","可配置爬虫","爬虫","爬虫就是我们通常说的网络爬虫了,本小节将介绍如下内容:","统计数据","运行爬虫","部署爬虫"],"Usage/Spider/Create.html":["crawlab允许用户创建两种爬虫:","创建爬虫","前者可以通过web界面和创建项目目录的方式来添加,后者由于没有源代码,只能通过web界面来添加。","可配置爬虫","自定义爬虫"],"Usage/Spider/CustomizedSpider.html":["crawlab会自动发现project_source_file_folder目录下的所有爬虫目录,并将这些目录生成自定义爬虫并集成到crawlab中。因此,将爬虫项目目录拷贝到project_source_file_folder目录下,就可以添加一个爬虫了。","在定义爬虫中,我们需要配置一下执行命令(运行爬虫时后台执行的shell命令)和结果集(通过crawlab_collection传递给爬虫程序,爬虫程序存储结果的地方),然后点击保存按钮保存爬虫信息。","在通过web界面上传之前,需要将爬虫项目文件打包成zip格式。","接下来,我们就可以部署、运行自定义爬虫了。","然后,在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮,选择自定义爬虫,点击上传按钮,选择刚刚打包好的zip文件。上传成功后,爬虫列表中会出现新添加的自定义爬虫。这样就算添加好了。","自定义爬虫","自定义爬虫是指用户可以添加的任何语言任何框架的爬虫,高度自定义化。当用户添加好自定义爬虫之后,crawlab就可以将其集成到爬虫管理的系统中来。","自定义爬虫的添加有两种方式:","这个方式稍微有些繁琐,但是对于无法轻松获取服务器的读写权限时是非常有用的,适合在生产环境上使用。","这种方式非常方便,但是需要获得主机服务器的读写权限,因而比较适合在开发环境上采用。","通过web界面上传","通过web界面上传爬虫","通过创建项目目录","通过添加项目目录","配置爬虫"],"Usage/Spider/ConfigurableSpider.html":["&","crawlab的可配置爬虫是基于scrapy的,因此天生支持并发。而且,可配置爬虫完全支持自定义爬虫的一般功能,因此也支持任务调度、任务监控、日志监控、数据分析。","仅列表页。这也是最简单的形式,爬虫遍历列表上的列表项,将数据抓取下来。","仅详情页。爬虫只抓取详情页。","分页选择器","列表+详情页。爬虫先遍历列表页,将列表项中的详情页地址提取出来并跟进抓取详情页。","列表页字段","列表项的匹和分页按钮的匹配查询,由css或xpath来进行匹配。","列表项选择器","可配置爬虫","可配置爬虫是版本v0.2.1开发的功能。目的是将具有相似网站结构的爬虫项目可配置化,将开发爬虫的过程流程化,大大提高爬虫开发效率。","在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮。","在检查完目标网页的元素css选择器之后,我们输入列表项选择器、开始url、列表页/详情页等信息。注意勾选url为详情页url。","开始url","抓取类别","添加完成后,可以看到刚刚添加的可配置爬虫出现了在最下方,点击查看进入到爬虫详情。","添加爬虫","点击保存、预览,查看预览内容。","点击可配置爬虫。","点击配置标签进入到配置页面。接下来,我们需要对爬虫规则进行配置。","爬虫最开始遍历的网址。","详情页字段","输入完基本信息,点击添加。","这个默认是开启的。如果开启,爬虫将先抓取网站的robots.txt并判断页面是否可抓;否则,不会对此进行验证。用户可以选择将其关闭。请注意,任何无视robots协议的行为都有法律风险。","这也是爬虫抓取采用的策略,也就是爬虫遍历网页是如何进行的。作为第一个版本,我们有仅列表、仅详情页、列表+详情页。","这些都是再列表页或详情页中需要提取的字段。字段由css选择器或者xpath来匹配提取。可以选择文本或者属性。","这里已经有一些配置好的初始输入项。我们简单介绍一下各自的含义。","这里我们选择列表+详情页。","遵守robots协议","配置爬虫"],"Usage/Spider/Deploy.html":["在爬虫列表中点击操作列的部署按钮,将指定爬虫部署到所有在线节点中;","在爬虫列表中点击部署所有爬虫,将所有爬虫部署到所有在线节点中;","在爬虫详情的概览标签中,点击部署按钮,将指定爬虫部署到所有在线节点中。","这里的爬虫部署是指自定义爬虫的部署,因为可配置爬虫已经内嵌到crawlab中了,所有节点都可以使用,不需要额外部署。简单来说,就是将主机上的爬虫源代码通过http的方式打包传输至worker节点上,因此节点就可以运行传输过来的爬虫了。","部署好之后,我们就可以运行爬虫了。","部署爬虫","部署爬虫很简单,有三种方式:"],"Usage/Spider/Run.html":["在爬虫列表中操作列点击运行按钮,或者","在爬虫详情中概览标签下点击运行按钮,或者","定时任务触发","定时任务触发是比较常用的功能,对于增量抓取或对实时性有要求的任务很重要。这在定时任务中会详细介绍。","对于自定义爬虫,可以在配置标签下点击运行按钮","我们有两种运行爬虫的方式:","手动触发","然后,crawlab会提示任务已经派发到队列中去了,然后你可以在爬虫详情左侧看到新创建的任务。点击创建时间可以导航至任务详情。","运行爬虫"],"Usage/Spider/Analytics.html":["在运行了一段时间之后,爬虫会积累一些统计数据,例如运行成功率、任务数、运行时长等指标。crawlab将这些指标汇总并呈现给开发者。","统计数据","要查看统计数据的话,只需要在爬虫详情中,点击分析标签,就可以看到爬虫的统计数据了。"],"Usage/Task/":["下载结果","任务","任务其实就是指某一次抓取任务或采集任务。任务与爬虫关联,其执行的也是爬虫指定的执行命令或采集规则。抓取或采集的结果与任务关联,因此可以查看到每一次任务的结果集。crawlab的任务是整个采集流程的核心,抓取的过程都是跟任务关联起来的,因此任务对于crawlab来说非常重要。任务被app触发,worker通过任务队列接收任务,然后在其所在节点上执行任务。","操作任务","本小节将介绍以下内容:","查看任务"],"Usage/Task/View.html":["任务列表","任务日志","任务结果","查看任务","点击侧边栏的任务导航至任务列表。可以看到最近的10个生成的任务。可以根据节点、爬虫来过滤任务。","点击操作列的查看按钮,进入到该任务的任务详情。","点击日志标签,可以查看任务日志。","点击结果标签,可以查看任务结果。"],"Usage/Task/Action.html":["停止任务","删除任务","在任务列表中,点击操作列中的删除按钮,确认删除该任务。","导航至需要停止的任务的任务详情,点击停止按钮来终止任务。","当任务运行起来之后,我们因为某个原因可能需要终止任务,这时我们需要在crawlab中停止该任务。","操作任务"],"Usage/Task/DownloadResults.html":["下载结果","导航至任务详情,点击结果标签,点击下载csv按钮,等待一会儿,结果就会以csv的形式下载到本地。","结果储存在数据库中之后,我们有时候需要将其导出,这时可以在界面中进行导出操作。"],"Usage/Schedule/":["job,apscheduler调度引擎将会不断的去数据库中匹配任务的执行时间,如果执行时间满足要求,则会在后台触发一次任务运行。","tasks,在linux中也被称为crontab。定时任务可以让任务可以被执行多次,而用户则不用手动的操作来执行任务。在生产环境中,这非常常见。定时任务对于对增量抓取或对数据实时性有要求的用户来说非常有用。","修改定时任务","创建定时任务","删除定时任务","在crawlab中,定时任务是通过apscheduler来实现的。创建一个定时任务之后,会在名为mongo的jobstore中创建一个period","定时任务","定时任务列表会进行更新。每一次爬虫更新、删除、创建,以及定时任务的更新、删除、创建,都会触发定时任务列表的更新。","定时任务是指定某个时刻,重复性地执行的任务,英文叫做period","导航至定时任务页面,可以看到定时任务的列表。","导航至定时任务页面,点击操作列的修改按钮,弹出修改定时任务的弹框。填写相应的内容,点击提交按钮修改定时任务。","导航至定时任务页面,点击操作列的删除按钮,确认删除该任务。","点击添加定时任务,弹出创建定时任务的弹框。填写相应的内容,点击提交按钮创建定时任务。","这里的cron跟linux中的crontab是一致的。如果对crontab不了解,可以参考这篇文章。"],"Usage/Site/":["网站","网站信息是帮助用户查看站长之家收录网站的信息的,包含robots协议、首页响应等信息。"],"Architecture/":["admin的单页应用。其中重用了很多el","app","app.py来启动应用。","backend","broker","crawlab的架构跟celery非常相似,但是加入了包括前端、爬虫、flower在内的额外模块,以支持爬虫管理的功能。架构图如下。","element","flower","frontend","node","spider","task","ui的控件来支持相应的展示。","一个celery的插件,用于监控celery节点。","中间者","中间者跟celery中定义的一样,作为运行异步任务的队列。","任务","任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。","前端","前端其实就是一个基于vue","后台应用","架构","爬虫","爬虫源代码或配置规则储存在app上,需要被部署到各个worker节点中。","节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口。","这是一个flask应用,提供了必要的api来支持常规操作,例如crud、爬虫部署以及任务运行。每一个节点需要启动flask应用来支持爬虫部署。运行python"],"Examples/":["与scrapy集成","样例"],"Examples/ScrapyIntegration.html":["#","'192.168.99.100'","'crawlab_test'","'test'","27017","=","class","col","col_nam","col_name:","db","db[col_name]","def","exampl","import","item","item,","item['task_id']","juejinpipeline(object):","mongo","mongo[mongo_db]","mongo_db","mongo_host","mongo_port","mongocli","mongoclient(host=mongo_host,","os","os.environ.get('crawlab_collection')","os.environ.get('crawlab_task_id')","pipelin","port=mongo_port)","process_item(self,","pymongo","return","scrapi","self.col.save(item)","spider):","与scrapy集成","以下是crawlab跟scrapy集成的例子,利用了crawlab传过来的task_id和collection_name。"]},"length":25},"tokenStore":{"root":{"1":{"6":{"docs":{},".":{"0":{"4":{"docs":{},"是":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}},"docs":{}},"docs":{}}},"docs":{}},"2":{"7":{"0":{"1":{"7":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},":":{"2":{"7":{"0":{"1":{"7":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"3":{"0":{"docs":{},"秒":{"docs":{},"的":{"docs":{},"时":{"docs":{},"间":{"docs":{},"来":{"docs":{},"b":{"docs":{},"u":{"docs":{},"i":{"docs":{},"l":{"docs":{},"d":{"docs":{},"前":{"docs":{},"端":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},",":{"docs":{},"之":{"docs":{},"后":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"打":{"docs":{},"开":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"地":{"docs":{},"址":{"docs":{},"地":{"docs":{},"址":{"docs":{},"看":{"docs":{},"到":{"docs":{},"界":{"docs":{},"面":{"docs":{},"了":{"docs":{},"。":{"docs":{},"界":{"docs":{},"面":{"docs":{},"地":{"docs":{},"址":{"docs":{},"默":{"docs":{},"认":{"docs":{},"为":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"8":{"0":{"0":{"0":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"8":{"0":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"./":{"ref":"./","tf":0.1111111111111111},"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.014634146341463415}},"主":{"docs":{},"要":{"docs":{},"解":{"docs":{},"决":{"docs":{},"的":{"docs":{},"是":{"docs":{},"大":{"docs":{},"量":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"困":{"docs":{},"难":{"docs":{},"的":{"docs":{},"问":{"docs":{},"题":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"需":{"docs":{},"要":{"docs":{},"监":{"docs":{},"控":{"docs":{},"上":{"docs":{},"百":{"docs":{},"个":{"docs":{},"网":{"docs":{},"站":{"docs":{},"的":{"docs":{},"参":{"docs":{},"杂":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"和":{"docs":{},"s":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"n":{"docs":{},"i":{"docs":{},"u":{"docs":{},"m":{"docs":{},"的":{"docs":{},"项":{"docs":{},"目":{"docs":{},"不":{"docs":{},"容":{"docs":{},"易":{"docs":{},"做":{"docs":{},"到":{"docs":{},"同":{"docs":{},"时":{"docs":{},"管":{"docs":{},"理":{"docs":{},",":{"docs":{},"而":{"docs":{},"且":{"docs":{},"命":{"docs":{},"令":{"docs":{},"行":{"docs":{},"管":{"docs":{},"理":{"docs":{},"的":{"docs":{},"成":{"docs":{},"本":{"docs":{},"非":{"docs":{},"常":{"docs":{},"高":{"docs":{},",":{"docs":{},"还":{"docs":{},"容":{"docs":{},"易":{"docs":{},"出":{"docs":{},"错":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"支":{"docs":{},"持":{"docs":{},"任":{"docs":{},"何":{"docs":{},"语":{"docs":{},"言":{"docs":{},"和":{"docs":{},"任":{"docs":{},"何":{"docs":{},"框":{"docs":{},"架":{"docs":{},",":{"docs":{},"配":{"docs":{},"合":{"docs":{},"任":{"docs":{},"务":{"docs":{},"调":{"docs":{},"度":{"docs":{},"、":{"docs":{},"任":{"docs":{},"务":{"docs":{},"监":{"docs":{},"控":{"docs":{},",":{"docs":{},"很":{"docs":{},"容":{"docs":{},"易":{"docs":{},"做":{"docs":{},"到":{"docs":{},"对":{"docs":{},"成":{"docs":{},"规":{"docs":{},"模":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"进":{"docs":{},"行":{"docs":{},"有":{"docs":{},"效":{"docs":{},"监":{"docs":{},"控":{"docs":{},"管":{"docs":{},"理":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"基":{"docs":{},"于":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"的":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"平":{"docs":{},"台":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"集":{"docs":{},"成":{"docs":{},"任":{"docs":{},"何":{"docs":{},"语":{"docs":{},"言":{"docs":{},"和":{"docs":{},"任":{"docs":{},"何":{"docs":{},"框":{"docs":{},"架":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"简":{"docs":{},"介":{"docs":{"./":{"ref":"./","tf":10}}}},"允":{"docs":{},"许":{"docs":{},"用":{"docs":{},"户":{"docs":{},"创":{"docs":{},"建":{"docs":{},"两":{"docs":{},"种":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},":":{"docs":{"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2}}}}}}}}}}}}},"会":{"docs":{},"自":{"docs":{},"动":{"docs":{},"发":{"docs":{},"现":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"_":{"docs":{},"s":{"docs":{},"o":{"docs":{},"u":{"docs":{},"r":{"docs":{},"c":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"i":{"docs":{},"l":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},"的":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"目":{"docs":{},"录":{"docs":{},",":{"docs":{},"并":{"docs":{},"将":{"docs":{},"这":{"docs":{},"些":{"docs":{},"目":{"docs":{},"录":{"docs":{},"生":{"docs":{},"成":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"并":{"docs":{},"集":{"docs":{},"成":{"docs":{},"到":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"中":{"docs":{},"。":{"docs":{},"因":{"docs":{},"此":{"docs":{},",":{"docs":{},"将":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{},"拷":{"docs":{},"贝":{"docs":{},"到":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"_":{"docs":{},"s":{"docs":{},"o":{"docs":{},"u":{"docs":{},"r":{"docs":{},"c":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"i":{"docs":{},"l":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},",":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"添":{"docs":{},"加":{"docs":{},"一":{"docs":{},"个":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"的":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"是":{"docs":{},"基":{"docs":{},"于":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"的":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"天":{"docs":{},"生":{"docs":{},"支":{"docs":{},"持":{"docs":{},"并":{"docs":{},"发":{"docs":{},"。":{"docs":{},"而":{"docs":{},"且":{"docs":{},",":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"完":{"docs":{},"全":{"docs":{},"支":{"docs":{},"持":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"一":{"docs":{},"般":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"也":{"docs":{},"支":{"docs":{},"持":{"docs":{},"任":{"docs":{},"务":{"docs":{},"调":{"docs":{},"度":{"docs":{},"、":{"docs":{},"任":{"docs":{},"务":{"docs":{},"监":{"docs":{},"控":{"docs":{},"、":{"docs":{},"日":{"docs":{},"志":{"docs":{},"监":{"docs":{},"控":{"docs":{},"、":{"docs":{},"数":{"docs":{},"据":{"docs":{},"分":{"docs":{},"析":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"架":{"docs":{},"构":{"docs":{},"跟":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"非":{"docs":{},"常":{"docs":{},"相":{"docs":{},"似":{"docs":{},",":{"docs":{},"但":{"docs":{},"是":{"docs":{},"加":{"docs":{},"入":{"docs":{},"了":{"docs":{},"包":{"docs":{},"括":{"docs":{},"前":{"docs":{},"端":{"docs":{},"、":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"、":{"docs":{},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{},"在":{"docs":{},"内":{"docs":{},"的":{"docs":{},"额":{"docs":{},"外":{"docs":{},"模":{"docs":{},"块":{"docs":{},",":{"docs":{},"以":{"docs":{},"支":{"docs":{},"持":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"的":{"docs":{},"功":{"docs":{},"能":{"docs":{},"。":{"docs":{},"架":{"docs":{},"构":{"docs":{},"图":{"docs":{},"如":{"docs":{},"下":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"n":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"m":{"docs":{},"\"":{"docs":{},"]":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}},"o":{"docs":{},"m":{"docs":{},"p":{"docs":{},"o":{"docs":{},"s":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"e":{"docs":{},".":{"docs":{},"y":{"docs":{},"m":{"docs":{},"l":{"docs":{},"后":{"docs":{},",":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"运":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"启":{"docs":{},"动":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}},"定":{"docs":{},"义":{"docs":{},"如":{"docs":{},"下":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}},"更":{"docs":{},"改":{"docs":{},"为":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"的":{"docs":{},"y":{"docs":{},"a":{"docs":{},"m":{"docs":{},"l":{"docs":{},"文":{"docs":{},"件":{"docs":{},"来":{"docs":{},"定":{"docs":{},"义":{"docs":{},"需":{"docs":{},"要":{"docs":{},"启":{"docs":{},"动":{"docs":{},"的":{"docs":{},"容":{"docs":{},"器":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"是":{"docs":{},"单":{"docs":{},"个":{"docs":{},",":{"docs":{},"也":{"docs":{},"可":{"docs":{},"以":{"docs":{},"(":{"docs":{},"通":{"docs":{},"常":{"docs":{},")":{"docs":{},"是":{"docs":{},"多":{"docs":{},"个":{"docs":{},"的":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"也":{"docs":{},"很":{"docs":{},"简":{"docs":{},"单":{"docs":{},",":{"docs":{},"大":{"docs":{},"家":{"docs":{},"去":{"docs":{},"网":{"docs":{},"上":{"docs":{},"百":{"docs":{},"度":{"docs":{},"一":{"docs":{},"下":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"了":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}},"和":{"docs":{},"定":{"docs":{},"义":{"docs":{},"好":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"是":{"docs":{},"一":{"docs":{},"个":{"docs":{},"集":{"docs":{},"群":{"docs":{},"管":{"docs":{},"理":{"docs":{},"方":{"docs":{},"式":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"利":{"docs":{},"用":{"docs":{},"名":{"docs":{},"为":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"很":{"docs":{},"适":{"docs":{},"合":{"docs":{},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"部":{"docs":{},"署":{"docs":{},",":{"docs":{},"在":{"docs":{},"原":{"docs":{},"有":{"docs":{},"的":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"基":{"docs":{},"础":{"docs":{},"上":{"docs":{},"增":{"docs":{},"加":{"docs":{},"几":{"docs":{},"个":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},",":{"docs":{},"达":{"docs":{},"到":{"docs":{},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"部":{"docs":{},"署":{"docs":{},"的":{"docs":{},"目":{"docs":{},"的":{"docs":{},"。":{"docs":{},"将":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"来":{"docs":{},"部":{"docs":{},"署":{"docs":{},"。":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}},"n":{"docs":{},"t":{"docs":{},"a":{"docs":{},"i":{"docs":{},"n":{"docs":{},"e":{"docs":{},"r":{"docs":{},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}},"l":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.04081632653061224}},"e":{"docs":{},":":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375}}},"l":{"docs":{},"o":{"docs":{},"n":{"docs":{},"e":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"a":{"docs":{},"s":{"docs":{},"s":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}},"d":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"e":{"docs":{},"m":{"docs":{},"o":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}},"p":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"s":{"docs":{},"_":{"docs":{},"o":{"docs":{},"n":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}}},"v":{"docs":{},".":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"m":{"docs":{},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}},"f":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25},"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":10.029268292682927}},"安":{"docs":{},"装":{"docs":{},"部":{"docs":{},"署":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}},"b":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},"[":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{},"]":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}},"基":{"docs":{},"于":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"平":{"docs":{},"台":{"docs":{},",":{"docs":{},"支":{"docs":{},"持":{"docs":{},"多":{"docs":{},"种":{"docs":{},"编":{"docs":{},"程":{"docs":{},"语":{"docs":{},"言":{"docs":{},"以":{"docs":{},"及":{"docs":{},"多":{"docs":{},"种":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"框":{"docs":{},"架":{"docs":{},".":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"本":{"docs":{},"使":{"docs":{},"用":{"docs":{},"手":{"docs":{},"册":{"docs":{},"会":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"您":{"docs":{},"解":{"docs":{},"决":{"docs":{},"在":{"docs":{},"安":{"docs":{},"装":{"docs":{},"使":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"遇":{"docs":{},"到":{"docs":{},"的":{"docs":{},"任":{"docs":{},"何":{"docs":{},"问":{"docs":{},"题":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"小":{"docs":{},"节":{"docs":{},"将":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"三":{"docs":{},"种":{"docs":{},"安":{"docs":{},"装":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25}}}}}}}}}}}}}}}},"如":{"docs":{},"何":{"docs":{},"使":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},",":{"docs":{},"包":{"docs":{},"括":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},":":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2}}}}}}}}}}}}}}}}}}}}},"以":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},":":{"docs":{"Usage/Task/":{"ref":"Usage/Task/","tf":0.16666666666666666}}}}}}}}}}}}},"查":{"docs":{},"看":{"docs":{},"演":{"docs":{},"示":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}},"节":{"docs":{},"点":{"docs":{"Usage/Node/":{"ref":"Usage/Node/","tf":0.25}},"列":{"docs":{},"表":{"docs":{"Usage/Node/View.html":{"ref":"Usage/Node/View.html","tf":10.333333333333334}}}}}},"任":{"docs":{},"务":{"docs":{"Usage/Task/":{"ref":"Usage/Task/","tf":0.16666666666666666},"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":10.125}}}}}},"项":{"docs":{},"目":{"docs":{},"自":{"docs":{},"今":{"docs":{},"年":{"docs":{},"三":{"docs":{},"月":{"docs":{},"份":{"docs":{},"上":{"docs":{},"线":{"docs":{},"以":{"docs":{},"来":{"docs":{},"受":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"爱":{"docs":{},"好":{"docs":{},"者":{"docs":{},"们":{"docs":{},"和":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"们":{"docs":{},"的":{"docs":{},"好":{"docs":{},"评":{"docs":{},",":{"docs":{},"不":{"docs":{},"少":{"docs":{},"使":{"docs":{},"用":{"docs":{},"者":{"docs":{},"还":{"docs":{},"表":{"docs":{},"示":{"docs":{},"会":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"搭":{"docs":{},"建":{"docs":{},"公":{"docs":{},"司":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"平":{"docs":{},"台":{"docs":{},"。":{"docs":{},"经":{"docs":{},"过":{"docs":{},"近":{"3":{"docs":{},"个":{"docs":{},"月":{"docs":{},"的":{"docs":{},"迭":{"docs":{},"代":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"陆":{"docs":{},"续":{"docs":{},"上":{"docs":{},"线":{"docs":{},"了":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"、":{"docs":{},"数":{"docs":{},"据":{"docs":{},"分":{"docs":{},"析":{"docs":{},"、":{"docs":{},"网":{"docs":{},"站":{"docs":{},"信":{"docs":{},"息":{"docs":{},"、":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"、":{"docs":{},"自":{"docs":{},"动":{"docs":{},"提":{"docs":{},"取":{"docs":{},"字":{"docs":{},"段":{"docs":{},"、":{"docs":{},"下":{"docs":{},"载":{"docs":{},"结":{"docs":{},"果":{"docs":{},"、":{"docs":{},"上":{"docs":{},"传":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"等":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"将":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"打":{"docs":{},"造":{"docs":{},"得":{"docs":{},"更":{"docs":{},"加":{"docs":{},"实":{"docs":{},"用":{"docs":{},",":{"docs":{},"更":{"docs":{},"加":{"docs":{},"全":{"docs":{},"面":{"docs":{},",":{"docs":{},"能":{"docs":{},"够":{"docs":{},"真":{"docs":{},"正":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"用":{"docs":{},"户":{"docs":{},"解":{"docs":{},"决":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"困":{"docs":{},"难":{"docs":{},"的":{"docs":{},"问":{"docs":{},"题":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"首":{"docs":{},"先":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"来":{"docs":{},"看":{"docs":{},"如":{"docs":{},"何":{"docs":{},"安":{"docs":{},"装":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"吧":{"docs":{},",":{"docs":{},"请":{"docs":{},"查":{"docs":{},"看":{"docs":{},"安":{"docs":{},"装":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"将":{"docs":{},"g":{"docs":{},"i":{"docs":{},"t":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},"上":{"docs":{},"的":{"docs":{},"代":{"docs":{},"码":{"docs":{},"拉":{"docs":{},"取":{"docs":{},"到":{"docs":{},"本":{"docs":{},"地":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}},"安":{"docs":{},"装":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/":{"ref":"Installation/","tf":10}}}}}}}}},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}},"完":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},",":{"docs":{},"在":{"docs":{},"u":{"docs":{},"b":{"docs":{},"u":{"docs":{},"n":{"docs":{},"t":{"docs":{},"u":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}},"前":{"docs":{},"端":{"docs":{},"所":{"docs":{},"需":{"docs":{},"库":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}},"后":{"docs":{},"端":{"docs":{},"所":{"docs":{},"需":{"docs":{},"库":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":10.0125}},"是":{"docs":{},"之":{"docs":{},"前":{"docs":{},"没":{"docs":{},"有":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"时":{"docs":{},"的":{"docs":{},"部":{"docs":{},"署":{"docs":{},"方":{"docs":{},"式":{"docs":{},",":{"docs":{},"相":{"docs":{},"对":{"docs":{},"于":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"部":{"docs":{},"署":{"docs":{},"来":{"docs":{},"说":{"docs":{},"有":{"docs":{},"些":{"docs":{},"繁":{"docs":{},"琐":{"docs":{},"。":{"docs":{},"但":{"docs":{},"了":{"docs":{},"解":{"docs":{},"如":{"docs":{},"何":{"docs":{},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{},"可":{"docs":{},"以":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"更":{"docs":{},"深":{"docs":{},"入":{"docs":{},"地":{"docs":{},"理":{"docs":{},"解":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"是":{"docs":{},"如":{"docs":{},"何":{"docs":{},"构":{"docs":{},"建":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"的":{"docs":{},"。":{"docs":{},"这":{"docs":{},"里":{"docs":{},"简":{"docs":{},"单":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"一":{"docs":{},"下":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"预":{"docs":{},"览":{"docs":{},"模":{"docs":{},"式":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25},"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":10.125}},"是":{"docs":{},"一":{"docs":{},"种":{"docs":{},"让":{"docs":{},"用":{"docs":{},"户":{"docs":{},"比":{"docs":{},"较":{"docs":{},"快":{"docs":{},"的":{"docs":{},"上":{"docs":{},"手":{"docs":{},"的":{"docs":{},"一":{"docs":{},"种":{"docs":{},"部":{"docs":{},"署":{"docs":{},"模":{"docs":{},"式":{"docs":{},"。":{"docs":{},"跟":{"docs":{},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{},"类":{"docs":{},"似":{"docs":{},",":{"docs":{},"但":{"docs":{},"不":{"docs":{},"用":{"docs":{},"经":{"docs":{},"过":{"docs":{},"构":{"docs":{},"建":{"docs":{},"、":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"和":{"docs":{},"启":{"docs":{},"动":{"docs":{},"服":{"docs":{},"务":{"docs":{},"的":{"docs":{},"步":{"docs":{},"骤":{"docs":{},"。":{"docs":{},"在":{"docs":{},"启":{"docs":{},"动":{"docs":{},"时":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"了":{"docs":{},"。":{"docs":{},"相":{"docs":{},"较":{"docs":{},"于":{"docs":{},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{},"来":{"docs":{},"说":{"docs":{},"方":{"docs":{},"便":{"docs":{},"一":{"docs":{},"些":{"docs":{},"。":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"\"":{"2":{"7":{"0":{"1":{"7":{"docs":{},":":{"2":{"7":{"0":{"1":{"7":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"6":{"3":{"7":{"9":{"docs":{},":":{"6":{"3":{"7":{"9":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"8":{"0":{"0":{"0":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"1":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"2":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"8":{"0":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"docs":{},"r":{"docs":{},"e":{"docs":{},"g":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"r":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}},"#":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.06829268292682927},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375},"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}},"'":{"1":{"9":{"2":{"docs":{},".":{"1":{"6":{"8":{"docs":{},".":{"9":{"9":{"docs":{},".":{"1":{"0":{"0":{"docs":{},"'":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"3":{"docs":{},".":{"3":{"docs":{},"'":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}}},"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{},"'":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{},"'":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}},"/":{"docs":{},"b":{"docs":{},"i":{"docs":{},"n":{"docs":{},"/":{"docs":{},"s":{"docs":{},"h":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},".":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"p":{"docs":{},"y":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"j":{"docs":{},"e":{"docs":{},"n":{"docs":{},"k":{"docs":{},"i":{"docs":{},"n":{"docs":{},"s":{"docs":{},"_":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"s":{"docs":{},"p":{"docs":{},"a":{"docs":{},"c":{"docs":{},"e":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"d":{"docs":{},"e":{"docs":{},"v":{"docs":{},"e":{"docs":{},"l":{"docs":{},"o":{"docs":{},"p":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"_":{"docs":{},"i":{"docs":{},"n":{"docs":{},"i":{"docs":{},"t":{"docs":{},".":{"docs":{},"s":{"docs":{},"h":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"[":{"docs":{},"\"":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},"s":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"r":{"docs":{},"e":{"docs":{},"g":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"r":{"docs":{},"y":{"docs":{},".":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},"]":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}},"\\":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.024390243902439025}}},"a":{"docs":{},"l":{"docs":{},"w":{"docs":{},"a":{"docs":{},"y":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}},"p":{"docs":{},"p":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}},"y":{"docs":{},"来":{"docs":{},"启":{"docs":{},"动":{"docs":{},"应":{"docs":{},"用":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}},"i":{"docs":{},"服":{"docs":{},"务":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}},"d":{"docs":{},"m":{"docs":{},"i":{"docs":{},"n":{"docs":{},"的":{"docs":{},"单":{"docs":{},"页":{"docs":{},"应":{"docs":{},"用":{"docs":{},"。":{"docs":{},"其":{"docs":{},"中":{"docs":{},"重":{"docs":{},"用":{"docs":{},"了":{"docs":{},"很":{"docs":{},"多":{"docs":{},"e":{"docs":{},"l":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{},"r":{"docs":{},"y":{"docs":{},"p":{"docs":{},"o":{"docs":{},"i":{"docs":{},"n":{"docs":{},"t":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}}}},"l":{"docs":{},"e":{"docs":{},"m":{"docs":{},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}},"x":{"docs":{},"a":{"docs":{},"m":{"docs":{},"p":{"docs":{},"l":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}},"i":{"docs":{},"m":{"docs":{},"a":{"docs":{},"g":{"docs":{},"e":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.03902439024390244}}}}}},"p":{"docs":{},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.04081632653061224}}}}}}},"n":{"docs":{},"d":{"docs":{},"e":{"docs":{},"x":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},".":{"docs":{},"h":{"docs":{},"t":{"docs":{},"m":{"docs":{},"l":{"docs":{},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}},"s":{"docs":{},"t":{"docs":{},"a":{"docs":{},"l":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.05}}}}}}},"t":{"docs":{},"e":{"docs":{},"m":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},",":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}},"[":{"docs":{},"'":{"docs":{},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"'":{"docs":{},"]":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.014634146341463415}},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}},"n":{"docs":{},"a":{"docs":{},"g":{"docs":{},"e":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}},"i":{"docs":{},"r":{"docs":{},"r":{"docs":{},"o":{"docs":{},"r":{"docs":{},"s":{"docs":{},"\"":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.024390243902439025},"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"l":{"docs":{},"a":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}},"一":{"docs":{},"行":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{},"如":{"docs":{},"何":{"docs":{},"安":{"docs":{},"装":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"跟":{"docs":{},"操":{"docs":{},"作":{"docs":{},"系":{"docs":{},"统":{"docs":{},"有":{"docs":{},"关":{"docs":{},",":{"docs":{},"这":{"docs":{},"里":{"docs":{},"就":{"docs":{},"不":{"docs":{},"展":{"docs":{},"开":{"docs":{},"讲":{"docs":{},"了":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"的":{"docs":{},"同":{"docs":{},"学":{"docs":{},"自":{"docs":{},"行":{"docs":{},"百":{"docs":{},"度":{"docs":{},"一":{"docs":{},"下":{"docs":{},"相":{"docs":{},"关":{"docs":{},"教":{"docs":{},"程":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"[":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"_":{"docs":{},"d":{"docs":{},"b":{"docs":{},"]":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}},"_":{"docs":{},"d":{"docs":{},"b":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}},"p":{"docs":{},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}},"c":{"docs":{},"l":{"docs":{},"i":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{},"(":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},"=":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"_":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},",":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375}}}}}},"p":{"docs":{},"m":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.025}}}},"o":{"docs":{},"d":{"docs":{},"e":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}},"p":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.014634146341463415}},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.03902439024390244}}}},"=":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"_":{"docs":{},"p":{"docs":{},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{},")":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}},"u":{"docs":{},"l":{"docs":{},"l":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}},"i":{"docs":{},"p":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"e":{"docs":{},"l":{"docs":{},"i":{"docs":{},"n":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}},"m":{"2":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0625}}},"docs":{}},"y":{"docs":{},"t":{"docs":{},"h":{"docs":{},"o":{"docs":{},"n":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}},"r":{"docs":{},"o":{"docs":{},"c":{"docs":{},"e":{"docs":{},"s":{"docs":{},"s":{"docs":{},"_":{"docs":{},"i":{"docs":{},"t":{"docs":{},"e":{"docs":{},"m":{"docs":{},"(":{"docs":{},"s":{"docs":{},"e":{"docs":{},"l":{"docs":{},"f":{"docs":{},",":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"l":{"docs":{},"a":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}},"s":{"docs":{},"t":{"docs":{},"a":{"docs":{},"r":{"docs":{},"t":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}},"l":{"docs":{},"o":{"docs":{},"a":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"q":{"docs":{},"u":{"docs":{},"i":{"docs":{},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"t":{"docs":{},"u":{"docs":{},"r":{"docs":{},"n":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}},"m":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"u":{"docs":{},"n":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125},"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}},"o":{"docs":{},"o":{"docs":{},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"s":{"docs":{},"e":{"docs":{},"r":{"docs":{},"v":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}},"i":{"docs":{},"c":{"docs":{},"e":{"docs":{},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}},"e":{"docs":{},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}},"来":{"docs":{},"进":{"docs":{},"行":{"docs":{},"的":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"是":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"模":{"docs":{},"式":{"docs":{},"。":{"docs":{},"注":{"docs":{},"意":{"docs":{},":":{"docs":{},"强":{"docs":{},"烈":{"docs":{},"不":{"docs":{},"建":{"docs":{},"议":{"docs":{},"在":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"中":{"docs":{},"用":{"docs":{},"预":{"docs":{},"览":{"docs":{},"模":{"docs":{},"式":{"docs":{},"。":{"docs":{},"预":{"docs":{},"览":{"docs":{},"模":{"docs":{},"式":{"docs":{},"只":{"docs":{},"是":{"docs":{},"让":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"快":{"docs":{},"速":{"docs":{},"体":{"docs":{},"验":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"以":{"docs":{},"及":{"docs":{},"调":{"docs":{},"试":{"docs":{},"代":{"docs":{},"码":{"docs":{},"问":{"docs":{},"题":{"docs":{},"的":{"docs":{},"一":{"docs":{},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},",":{"docs":{},"而":{"docs":{},"不":{"docs":{},"是":{"docs":{},"用":{"docs":{},"作":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"部":{"docs":{},"署":{"docs":{},"的":{"docs":{},"。":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"l":{"docs":{},"f":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},".":{"docs":{},"s":{"docs":{},"a":{"docs":{},"v":{"docs":{},"e":{"docs":{},"(":{"docs":{},"i":{"docs":{},"t":{"docs":{},"e":{"docs":{},"m":{"docs":{},")":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}},"t":{"docs":{},"a":{"docs":{},"r":{"docs":{},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375}}}}}},"u":{"docs":{},"d":{"docs":{},"o":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"p":{"docs":{},"i":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},")":{"docs":{},":":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}},"t":{"docs":{},"i":{"docs":{},"k":{"docs":{},"a":{"docs":{},"z":{"docs":{},"y":{"docs":{},"q":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}},":":{"docs":{},"l":{"docs":{},"a":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.024390243902439025}}}}}}}}}}}}}}}}}}}}}}},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"s":{"docs":{},",":{"docs":{},"在":{"docs":{},"l":{"docs":{},"i":{"docs":{},"n":{"docs":{},"u":{"docs":{},"x":{"docs":{},"中":{"docs":{},"也":{"docs":{},"被":{"docs":{},"称":{"docs":{},"为":{"docs":{},"c":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"可":{"docs":{},"以":{"docs":{},"让":{"docs":{},"任":{"docs":{},"务":{"docs":{},"可":{"docs":{},"以":{"docs":{},"被":{"docs":{},"执":{"docs":{},"行":{"docs":{},"多":{"docs":{},"次":{"docs":{},",":{"docs":{},"而":{"docs":{},"用":{"docs":{},"户":{"docs":{},"则":{"docs":{},"不":{"docs":{},"用":{"docs":{},"手":{"docs":{},"动":{"docs":{},"的":{"docs":{},"操":{"docs":{},"作":{"docs":{},"来":{"docs":{},"执":{"docs":{},"行":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"在":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"中":{"docs":{},",":{"docs":{},"这":{"docs":{},"非":{"docs":{},"常":{"docs":{},"常":{"docs":{},"见":{"docs":{},"。":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"对":{"docs":{},"于":{"docs":{},"对":{"docs":{},"增":{"docs":{},"量":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"或":{"docs":{},"对":{"docs":{},"数":{"docs":{},"据":{"docs":{},"实":{"docs":{},"时":{"docs":{},"性":{"docs":{},"有":{"docs":{},"要":{"docs":{},"求":{"docs":{},"的":{"docs":{},"用":{"docs":{},"户":{"docs":{},"来":{"docs":{},"说":{"docs":{},"非":{"docs":{},"常":{"docs":{},"有":{"docs":{},"用":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"u":{"docs":{},"p":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"i":{"docs":{},"的":{"docs":{},"控":{"docs":{},"件":{"docs":{},"来":{"docs":{},"支":{"docs":{},"持":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"展":{"docs":{},"示":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}},"v":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"e":{"docs":{},"r":{"docs":{},"s":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}},"o":{"docs":{},"l":{"docs":{},"u":{"docs":{},"m":{"docs":{},"n":{"docs":{},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"1":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"2":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},",":{"docs":{},"他":{"docs":{},"们":{"docs":{},"通":{"docs":{},"过":{"docs":{},"连":{"docs":{},"接":{"docs":{},"到":{"docs":{},"配":{"docs":{},"置":{"docs":{},"好":{"docs":{},"的":{"docs":{},"b":{"docs":{},"r":{"docs":{},"o":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"(":{"docs":{},"通":{"docs":{},"常":{"docs":{},"是":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},")":{"docs":{},"来":{"docs":{},"进":{"docs":{},"行":{"docs":{},"与":{"docs":{},"主":{"docs":{},"机":{"docs":{},"的":{"docs":{},"通":{"docs":{},"信":{"docs":{},"。":{"docs":{"Usage/Node/View.html":{"ref":"Usage/Node/View.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"{":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}},"}":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}},"下":{"docs":{},"载":{"docs":{},"镜":{"docs":{},"像":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"结":{"docs":{},"果":{"docs":{"Usage/Task/":{"ref":"Usage/Task/","tf":0.16666666666666666},"Usage/Task/DownloadResults.html":{"ref":"Usage/Task/DownloadResults.html","tf":10.333333333333334}}}}}},"其":{"docs":{},"中":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"映":{"docs":{},"射":{"docs":{},"了":{"8":{"0":{"8":{"0":{"docs":{},"端":{"docs":{},"口":{"docs":{},"(":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"前":{"docs":{},"端":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},")":{"docs":{},"以":{"docs":{},"及":{"8":{"0":{"0":{"0":{"docs":{},"端":{"docs":{},"口":{"docs":{},"(":{"docs":{},"后":{"docs":{},"端":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},")":{"docs":{},"到":{"docs":{},"宿":{"docs":{},"主":{"docs":{},"机":{"docs":{},"。":{"docs":{},"另":{"docs":{},"外":{"docs":{},"还":{"docs":{},"将":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"和":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"映":{"docs":{},"射":{"docs":{},"到":{"docs":{},"了":{"docs":{},"容":{"docs":{},"器":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},"。":{"docs":{},"传":{"docs":{},"入":{"docs":{},"参":{"docs":{},"数":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"是":{"docs":{},"代":{"docs":{},"表":{"docs":{},"该":{"docs":{},"启":{"docs":{},"动":{"docs":{},"方":{"docs":{},"式":{"docs":{},"为":{"docs":{},"主":{"docs":{},"机":{"docs":{},"启":{"docs":{},"动":{"docs":{},"模":{"docs":{},"式":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"所":{"docs":{},"有":{"docs":{},"服":{"docs":{},"务":{"docs":{},"(":{"docs":{},"前":{"docs":{},"端":{"docs":{},"、":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"、":{"docs":{},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{},"、":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},")":{"docs":{},"都":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"docs":{},"。":{"docs":{},"另":{"docs":{},"外":{"docs":{},"一":{"docs":{},"个":{"docs":{},"模":{"docs":{},"式":{"docs":{},"是":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"模":{"docs":{},"式":{"docs":{},",":{"docs":{},"只":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"docs":{},"必":{"docs":{},"要":{"docs":{},"的":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"和":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"服":{"docs":{},"务":{"docs":{},",":{"docs":{},"这":{"docs":{},"个":{"docs":{},"对":{"docs":{},"于":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"部":{"docs":{},"署":{"docs":{},"比":{"docs":{},"较":{"docs":{},"有":{"docs":{},"用":{"docs":{},"。":{"docs":{},"等":{"docs":{},"待":{"docs":{},"大":{"docs":{},"约":{"2":{"0":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}},"r":{"docs":{},"o":{"docs":{},"o":{"docs":{},"t":{"docs":{},"是":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},"的":{"docs":{},"根":{"docs":{},"目":{"docs":{},"录":{"docs":{},",":{"docs":{},"这":{"docs":{},"里":{"docs":{},"是":{"docs":{},"n":{"docs":{},"p":{"docs":{},"m":{"docs":{},"打":{"docs":{},"包":{"docs":{},"好":{"docs":{},"后":{"docs":{},"的":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"前":{"docs":{},"端":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"一":{"docs":{},"个":{"docs":{},"基":{"docs":{},"于":{"docs":{},"v":{"docs":{},"u":{"docs":{},"e":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}},"者":{"docs":{},"可":{"docs":{},"以":{"docs":{},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"和":{"docs":{},"创":{"docs":{},"建":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"来":{"docs":{},"添":{"docs":{},"加":{"docs":{},",":{"docs":{},"后":{"docs":{},"者":{"docs":{},"由":{"docs":{},"于":{"docs":{},"没":{"docs":{},"有":{"docs":{},"源":{"docs":{},"代":{"docs":{},"码":{"docs":{},",":{"docs":{},"只":{"docs":{},"能":{"docs":{},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"来":{"docs":{},"添":{"docs":{},"加":{"docs":{},"。":{"docs":{"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"同":{"docs":{},"样":{"docs":{},",":{"docs":{},"在":{"docs":{},"浏":{"docs":{},"览":{"docs":{},"器":{"docs":{},"中":{"docs":{},"输":{"docs":{},"入":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"界":{"docs":{},"面":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}},"面":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"让":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"运":{"docs":{},"行":{"docs":{},"在":{"docs":{},"各":{"docs":{},"个":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"让":{"docs":{},"主":{"docs":{},"机":{"docs":{},"与":{"docs":{},"节":{"docs":{},"点":{"docs":{},"进":{"docs":{},"行":{"docs":{},"通":{"docs":{},"信":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"需":{"docs":{},"要":{"docs":{},"知":{"docs":{},"道":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},"和":{"docs":{},"端":{"docs":{},"口":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"手":{"docs":{},"动":{"docs":{},"配":{"docs":{},"置":{"docs":{},"一":{"docs":{},"下":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"和":{"docs":{},"端":{"docs":{},"口":{"docs":{},"。":{"docs":{},"在":{"docs":{},"节":{"docs":{},"点":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},"点":{"docs":{},"击":{"docs":{},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"里":{"docs":{},"的":{"docs":{},"蓝":{"docs":{},"色":{"docs":{},"查":{"docs":{},"看":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"节":{"docs":{},"点":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{},"节":{"docs":{},"点":{"docs":{},"详":{"docs":{},"情":{"docs":{},"样":{"docs":{},"子":{"docs":{},"如":{"docs":{},"下":{"docs":{},"。":{"docs":{"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":0.25}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"台":{"docs":{},"应":{"docs":{},"用":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"模":{"docs":{},"式":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}},"对":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"不":{"docs":{},"了":{"docs":{},"解":{"docs":{},"的":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"参":{"docs":{},"考":{"docs":{},"一":{"docs":{},"下":{"docs":{},"这":{"docs":{},"篇":{"docs":{},"文":{"docs":{},"章":{"docs":{},"(":{"9":{"1":{"0":{"2":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}},"于":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"配":{"docs":{},"置":{"docs":{},"标":{"docs":{},"签":{"docs":{},"下":{"docs":{},"点":{"docs":{},"击":{"docs":{},"运":{"docs":{},"行":{"docs":{},"按":{"docs":{},"钮":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}}}}},"年":{"docs":{},"了":{"docs":{},",":{"docs":{},"学":{"docs":{},"点":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}},"当":{"docs":{},"然":{"docs":{},",":{"docs":{},"也":{"docs":{},"可":{"docs":{},"以":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}},"任":{"docs":{},"务":{"docs":{},"运":{"docs":{},"行":{"docs":{},"起":{"docs":{},"来":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"因":{"docs":{},"为":{"docs":{},"某":{"docs":{},"个":{"docs":{},"原":{"docs":{},"因":{"docs":{},"可":{"docs":{},"能":{"docs":{},"需":{"docs":{},"要":{"docs":{},"终":{"docs":{},"止":{"docs":{},"任":{"docs":{},"务":{"docs":{},",":{"docs":{},"这":{"docs":{},"时":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"在":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"中":{"docs":{},"停":{"docs":{},"止":{"docs":{},"该":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":0.16666666666666666}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"我":{"docs":{},"们":{"docs":{},"已":{"docs":{},"经":{"docs":{},"在":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},"上":{"docs":{},"构":{"docs":{},"建":{"docs":{},"了":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},",":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"将":{"docs":{},"其":{"docs":{},"p":{"docs":{},"u":{"docs":{},"l":{"docs":{},"l":{"docs":{},"下":{"docs":{},"来":{"docs":{},"使":{"docs":{},"用":{"docs":{},"。":{"docs":{},"在":{"docs":{},"p":{"docs":{},"u":{"docs":{},"l":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"有":{"docs":{},"两":{"docs":{},"种":{"docs":{},"运":{"docs":{},"行":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"将":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"下":{"docs":{},"载":{"docs":{},"下":{"docs":{},"来":{"docs":{},"。":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"大":{"docs":{},"小":{"docs":{},"大":{"docs":{},"概":{"docs":{},"在":{"docs":{},"几":{"docs":{},"百":{"docs":{},"兆":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"下":{"docs":{},"载":{"docs":{},"需":{"docs":{},"要":{"docs":{},"几":{"docs":{},"分":{"docs":{},"钟":{"docs":{},"时":{"docs":{},"间":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"拷":{"docs":{},"贝":{"docs":{},"一":{"docs":{},"份":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"以":{"docs":{},"及":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"到":{"docs":{},"某":{"docs":{},"一":{"docs":{},"个":{"docs":{},"地":{"docs":{},"方":{"docs":{},"。":{"docs":{},"例":{"docs":{},"如":{"docs":{},"我":{"docs":{},"的":{"docs":{},"例":{"docs":{},"子":{"docs":{},",":{"docs":{},"分":{"docs":{},"别":{"docs":{},"为":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"和":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"更":{"docs":{},"改":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},",":{"docs":{},"将":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"、":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"的":{"docs":{},"指":{"docs":{},"向":{"docs":{},"i":{"docs":{},"p":{"docs":{},"更":{"docs":{},"改":{"docs":{},"为":{"docs":{},"自":{"docs":{},"己":{"docs":{},"数":{"docs":{},"据":{"docs":{},"的":{"docs":{},"值":{"docs":{},"。":{"docs":{},"注":{"docs":{},"意":{"docs":{},",":{"docs":{},"容":{"docs":{},"器":{"docs":{},"中":{"docs":{},"对":{"docs":{},"应":{"docs":{},"的":{"docs":{},"宿":{"docs":{},"主":{"docs":{},"机":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},"不":{"docs":{},"是":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},",":{"docs":{},"而":{"docs":{},"是":{"1":{"7":{"2":{"docs":{},".":{"1":{"7":{"docs":{},".":{"0":{"docs":{},".":{"1":{"docs":{},"(":{"docs":{},"当":{"docs":{},"然":{"docs":{},"也":{"docs":{},"可":{"docs":{},"以":{"docs":{},"用":{"docs":{},"n":{"docs":{},"e":{"docs":{},"t":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"来":{"docs":{},"做":{"docs":{},",":{"docs":{},"只":{"docs":{},"是":{"docs":{},"稍":{"docs":{},"微":{"docs":{},"麻":{"docs":{},"烦":{"docs":{},"一":{"docs":{},"些":{"docs":{},")":{"docs":{},"。":{"docs":{},"更":{"docs":{},"改":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},",":{"docs":{},"将":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"地":{"docs":{},"址":{"docs":{},"v":{"docs":{},"u":{"docs":{},"e":{"docs":{},"_":{"docs":{},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},"_":{"docs":{},"b":{"docs":{},"a":{"docs":{},"s":{"docs":{},"e":{"docs":{},"_":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"更":{"docs":{},"改":{"docs":{},"为":{"docs":{},"宿":{"docs":{},"主":{"docs":{},"机":{"docs":{},"所":{"docs":{},"在":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"1":{"9":{"2":{"docs":{},".":{"1":{"6":{"8":{"docs":{},".":{"0":{"docs":{},".":{"8":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},",":{"docs":{},"这":{"docs":{},"将":{"docs":{},"是":{"docs":{},"前":{"docs":{},"端":{"docs":{},"调":{"docs":{},"用":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"会":{"docs":{},"用":{"docs":{},"到":{"docs":{},"的":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}},"docs":{}}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"好":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"接":{"docs":{},"下":{"docs":{},"来":{"docs":{},"就":{"docs":{},"是":{"docs":{},"运":{"docs":{},"行":{"docs":{},"容":{"docs":{},"器":{"docs":{},"了":{"docs":{},"。":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"来":{"docs":{},"启":{"docs":{},"动":{"docs":{},"容":{"docs":{},"器":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}},"知":{"docs":{},"识":{"docs":{},")":{"docs":{},"做":{"docs":{},"进":{"docs":{},"一":{"docs":{},"步":{"docs":{},"了":{"docs":{},"解":{"docs":{},"。":{"docs":{},"简":{"docs":{},"单":{"docs":{},"来":{"docs":{},"说":{"docs":{},",":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"可":{"docs":{},"以":{"docs":{},"利":{"docs":{},"用":{"docs":{},"已":{"docs":{},"存":{"docs":{},"在":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"构":{"docs":{},"建":{"docs":{},"一":{"docs":{},"些":{"docs":{},"常":{"docs":{},"用":{"docs":{},"的":{"docs":{},"服":{"docs":{},"务":{"docs":{},"和":{"docs":{},"应":{"docs":{},"用":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"、":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"、":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"等":{"docs":{},"等":{"docs":{},"。":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"运":{"docs":{},"行":{"docs":{},"一":{"docs":{},"个":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"服":{"docs":{},"务":{"docs":{},"仅":{"docs":{},"需":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"运":{"docs":{},"行":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"容":{"docs":{},"器":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":10.090909090909092}}}}}},"这":{"docs":{},"应":{"docs":{},"该":{"docs":{},"是":{"docs":{},"部":{"docs":{},"署":{"docs":{},"应":{"docs":{},"用":{"docs":{},"的":{"docs":{},"最":{"docs":{},"方":{"docs":{},"便":{"docs":{},"也":{"docs":{},"是":{"docs":{},"最":{"docs":{},"节":{"docs":{},"省":{"docs":{},"时":{"docs":{},"间":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"了":{"docs":{},"。":{"docs":{},"在":{"docs":{},"最":{"docs":{},"近":{"docs":{},"的":{"docs":{},"一":{"docs":{},"次":{"docs":{},"版":{"docs":{},"本":{"docs":{},"更":{"docs":{},"新":{"docs":{},"v":{"0":{"docs":{},".":{"2":{"docs":{},".":{"3":{"docs":{},"中":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"发":{"docs":{},"布":{"docs":{},"了":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"让":{"docs":{},"大":{"docs":{},"家":{"docs":{},"可":{"docs":{},"以":{"docs":{},"利":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"来":{"docs":{},"轻":{"docs":{},"松":{"docs":{},"部":{"docs":{},"署":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{},"下":{"docs":{},"面":{"docs":{},"将":{"docs":{},"一":{"docs":{},"步":{"docs":{},"一":{"docs":{},"步":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"如":{"docs":{},"何":{"docs":{},"使":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"来":{"docs":{},"部":{"docs":{},"署":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}},"docs":{}}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"样":{"docs":{},"的":{"docs":{},"话":{"docs":{},",":{"docs":{},"p":{"docs":{},"u":{"docs":{},"l":{"docs":{},"l":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"的":{"docs":{},"速":{"docs":{},"度":{"docs":{},"会":{"docs":{},"比":{"docs":{},"不":{"docs":{},"改":{"docs":{},"变":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"源":{"docs":{},"的":{"docs":{},"速":{"docs":{},"度":{"docs":{},"快":{"docs":{},"很":{"docs":{},"多":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}},",":{"docs":{},"p":{"docs":{},"m":{"2":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"3":{"docs":{},"个":{"docs":{},"守":{"docs":{},"护":{"docs":{},"进":{"docs":{},"程":{"docs":{},"来":{"docs":{},"管":{"docs":{},"理":{"docs":{},"这":{"3":{"docs":{},"个":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"如":{"docs":{},"果":{"docs":{},"想":{"docs":{},"看":{"docs":{},"后":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"的":{"docs":{},"日":{"docs":{},"志":{"docs":{},"的":{"docs":{},"话":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}}}}}}}}}},"docs":{}}}}},"docs":{}}},"我":{"docs":{},"们":{"docs":{},"就":{"docs":{},"完":{"docs":{},"成":{"docs":{},"了":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"配":{"docs":{},"置":{"docs":{},"工":{"docs":{},"作":{"docs":{},"。":{"docs":{"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":0.25}}}}}}}}}}}}}}}}}},"里":{"docs":{},"先":{"docs":{},"定":{"docs":{},"义":{"docs":{},"了":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"主":{"docs":{},"节":{"docs":{},"点":{"docs":{},"。":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"依":{"docs":{},"赖":{"docs":{},"于":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"和":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"容":{"docs":{},"器":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"在":{"docs":{},"启":{"docs":{},"动":{"docs":{},"之":{"docs":{},"前":{"docs":{},"会":{"docs":{},"同":{"docs":{},"时":{"docs":{},"启":{"docs":{},"动":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"和":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"容":{"docs":{},"器":{"docs":{},"。":{"docs":{},"这":{"docs":{},"样":{"docs":{},"就":{"docs":{},"不":{"docs":{},"需":{"docs":{},"要":{"docs":{},"单":{"docs":{},"独":{"docs":{},"配":{"docs":{},"置":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"和":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"服":{"docs":{},"务":{"docs":{},"了":{"docs":{},",":{"docs":{},"大":{"docs":{},"大":{"docs":{},"节":{"docs":{},"省":{"docs":{},"了":{"docs":{},"环":{"docs":{},"境":{"docs":{},"配":{"docs":{},"置":{"docs":{},"的":{"docs":{},"时":{"docs":{},"间":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"启":{"docs":{},"动":{"docs":{},"了":{"docs":{},"多":{"docs":{},"增":{"docs":{},"加":{"docs":{},"了":{"docs":{},"两":{"docs":{},"个":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},",":{"docs":{},"以":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"模":{"docs":{},"式":{"docs":{},"启":{"docs":{},"动":{"docs":{},"。":{"docs":{},"这":{"docs":{},"样":{"docs":{},",":{"docs":{},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"部":{"docs":{},"署":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"部":{"docs":{},"署":{"docs":{},"就":{"docs":{},"完":{"docs":{},"成":{"docs":{},"了":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"指":{"docs":{},"启":{"docs":{},"动":{"docs":{},"后":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"用":{"docs":{},"p":{"docs":{},"m":{"2":{"docs":{},"来":{"docs":{},"管":{"docs":{},"理":{"docs":{},"进":{"docs":{},"程":{"docs":{},"。":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}},"docs":{}}}}}}}}}}}}}}},"的":{"docs":{},"构":{"docs":{},"建":{"docs":{},"是":{"docs":{},"指":{"docs":{},"前":{"docs":{},"端":{"docs":{},"构":{"docs":{},"建":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"是":{"docs":{},"指":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"部":{"docs":{},"署":{"docs":{},",":{"docs":{},"因":{"docs":{},"为":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"已":{"docs":{},"经":{"docs":{},"内":{"docs":{},"嵌":{"docs":{},"到":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"中":{"docs":{},"了":{"docs":{},",":{"docs":{},"所":{"docs":{},"有":{"docs":{},"节":{"docs":{},"点":{"docs":{},"都":{"docs":{},"可":{"docs":{},"以":{"docs":{},"使":{"docs":{},"用":{"docs":{},",":{"docs":{},"不":{"docs":{},"需":{"docs":{},"要":{"docs":{},"额":{"docs":{},"外":{"docs":{},"部":{"docs":{},"署":{"docs":{},"。":{"docs":{},"简":{"docs":{},"单":{"docs":{},"来":{"docs":{},"说":{"docs":{},",":{"docs":{},"就":{"docs":{},"是":{"docs":{},"将":{"docs":{},"主":{"docs":{},"机":{"docs":{},"上":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"源":{"docs":{},"代":{"docs":{},"码":{"docs":{},"通":{"docs":{},"过":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"打":{"docs":{},"包":{"docs":{},"传":{"docs":{},"输":{"docs":{},"至":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"节":{"docs":{},"点":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"运":{"docs":{},"行":{"docs":{},"传":{"docs":{},"输":{"docs":{},"过":{"docs":{},"来":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"跟":{"docs":{},"l":{"docs":{},"i":{"docs":{},"n":{"docs":{},"u":{"docs":{},"x":{"docs":{},"中":{"docs":{},"的":{"docs":{},"c":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"a":{"docs":{},"b":{"docs":{},"是":{"docs":{},"一":{"docs":{},"致":{"docs":{},"的":{"docs":{},"。":{"docs":{},"如":{"docs":{},"果":{"docs":{},"对":{"docs":{},"c":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"a":{"docs":{},"b":{"docs":{},"不":{"docs":{},"了":{"docs":{},"解":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"参":{"docs":{},"考":{"docs":{},"这":{"docs":{},"篇":{"docs":{},"文":{"docs":{},"章":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"已":{"docs":{},"经":{"docs":{},"有":{"docs":{},"一":{"docs":{},"些":{"docs":{},"配":{"docs":{},"置":{"docs":{},"好":{"docs":{},"的":{"docs":{},"初":{"docs":{},"始":{"docs":{},"输":{"docs":{},"入":{"docs":{},"项":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"简":{"docs":{},"单":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"一":{"docs":{},"下":{"docs":{},"各":{"docs":{},"自":{"docs":{},"的":{"docs":{},"含":{"docs":{},"义":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"我":{"docs":{},"们":{"docs":{},"选":{"docs":{},"择":{"docs":{},"列":{"docs":{},"表":{"docs":{},"+":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}},"个":{"docs":{},"方":{"docs":{},"式":{"docs":{},"稍":{"docs":{},"微":{"docs":{},"有":{"docs":{},"些":{"docs":{},"繁":{"docs":{},"琐":{"docs":{},",":{"docs":{},"但":{"docs":{},"是":{"docs":{},"对":{"docs":{},"于":{"docs":{},"无":{"docs":{},"法":{"docs":{},"轻":{"docs":{},"松":{"docs":{},"获":{"docs":{},"取":{"docs":{},"服":{"docs":{},"务":{"docs":{},"器":{"docs":{},"的":{"docs":{},"读":{"docs":{},"写":{"docs":{},"权":{"docs":{},"限":{"docs":{},"时":{"docs":{},"是":{"docs":{},"非":{"docs":{},"常":{"docs":{},"有":{"docs":{},"用":{"docs":{},"的":{"docs":{},",":{"docs":{},"适":{"docs":{},"合":{"docs":{},"在":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"上":{"docs":{},"使":{"docs":{},"用":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"默":{"docs":{},"认":{"docs":{},"是":{"docs":{},"开":{"docs":{},"启":{"docs":{},"的":{"docs":{},"。":{"docs":{},"如":{"docs":{},"果":{"docs":{},"开":{"docs":{},"启":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"将":{"docs":{},"先":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"网":{"docs":{},"站":{"docs":{},"的":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},".":{"docs":{},"t":{"docs":{},"x":{"docs":{},"t":{"docs":{},"并":{"docs":{},"判":{"docs":{},"断":{"docs":{},"页":{"docs":{},"面":{"docs":{},"是":{"docs":{},"否":{"docs":{},"可":{"docs":{},"抓":{"docs":{},";":{"docs":{},"否":{"docs":{},"则":{"docs":{},",":{"docs":{},"不":{"docs":{},"会":{"docs":{},"对":{"docs":{},"此":{"docs":{},"进":{"docs":{},"行":{"docs":{},"验":{"docs":{},"证":{"docs":{},"。":{"docs":{},"用":{"docs":{},"户":{"docs":{},"可":{"docs":{},"以":{"docs":{},"选":{"docs":{},"择":{"docs":{},"将":{"docs":{},"其":{"docs":{},"关":{"docs":{},"闭":{"docs":{},"。":{"docs":{},"请":{"docs":{},"注":{"docs":{},"意":{"docs":{},",":{"docs":{},"任":{"docs":{},"何":{"docs":{},"无":{"docs":{},"视":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},"协":{"docs":{},"议":{"docs":{},"的":{"docs":{},"行":{"docs":{},"为":{"docs":{},"都":{"docs":{},"有":{"docs":{},"法":{"docs":{},"律":{"docs":{},"风":{"docs":{},"险":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},"非":{"docs":{},"常":{"docs":{},"方":{"docs":{},"便":{"docs":{},",":{"docs":{},"但":{"docs":{},"是":{"docs":{},"需":{"docs":{},"要":{"docs":{},"获":{"docs":{},"得":{"docs":{},"主":{"docs":{},"机":{"docs":{},"服":{"docs":{},"务":{"docs":{},"器":{"docs":{},"的":{"docs":{},"读":{"docs":{},"写":{"docs":{},"权":{"docs":{},"限":{"docs":{},",":{"docs":{},"因":{"docs":{},"而":{"docs":{},"比":{"docs":{},"较":{"docs":{},"适":{"docs":{},"合":{"docs":{},"在":{"docs":{},"开":{"docs":{},"发":{"docs":{},"环":{"docs":{},"境":{"docs":{},"上":{"docs":{},"采":{"docs":{},"用":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"也":{"docs":{},"是":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"采":{"docs":{},"用":{"docs":{},"的":{"docs":{},"策":{"docs":{},"略":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"网":{"docs":{},"页":{"docs":{},"是":{"docs":{},"如":{"docs":{},"何":{"docs":{},"进":{"docs":{},"行":{"docs":{},"的":{"docs":{},"。":{"docs":{},"作":{"docs":{},"为":{"docs":{},"第":{"docs":{},"一":{"docs":{},"个":{"docs":{},"版":{"docs":{},"本":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"有":{"docs":{},"仅":{"docs":{},"列":{"docs":{},"表":{"docs":{},"、":{"docs":{},"仅":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"、":{"docs":{},"列":{"docs":{},"表":{"docs":{},"+":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"些":{"docs":{},"都":{"docs":{},"是":{"docs":{},"再":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},"或":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"中":{"docs":{},"需":{"docs":{},"要":{"docs":{},"提":{"docs":{},"取":{"docs":{},"的":{"docs":{},"字":{"docs":{},"段":{"docs":{},"。":{"docs":{},"字":{"docs":{},"段":{"docs":{},"由":{"docs":{},"c":{"docs":{},"s":{"docs":{},"s":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{},"或":{"docs":{},"者":{"docs":{},"x":{"docs":{},"p":{"docs":{},"a":{"docs":{},"t":{"docs":{},"h":{"docs":{},"来":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"提":{"docs":{},"取":{"docs":{},"。":{"docs":{},"可":{"docs":{},"以":{"docs":{},"选":{"docs":{},"择":{"docs":{},"文":{"docs":{},"本":{"docs":{},"或":{"docs":{},"者":{"docs":{},"属":{"docs":{},"性":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"一":{"docs":{},"个":{"docs":{},"f":{"docs":{},"l":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"应":{"docs":{},"用":{"docs":{},",":{"docs":{},"提":{"docs":{},"供":{"docs":{},"了":{"docs":{},"必":{"docs":{},"要":{"docs":{},"的":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"来":{"docs":{},"支":{"docs":{},"持":{"docs":{},"常":{"docs":{},"规":{"docs":{},"操":{"docs":{},"作":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"c":{"docs":{},"r":{"docs":{},"u":{"docs":{},"d":{"docs":{},"、":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"以":{"docs":{},"及":{"docs":{},"任":{"docs":{},"务":{"docs":{},"运":{"docs":{},"行":{"docs":{},"。":{"docs":{},"每":{"docs":{},"一":{"docs":{},"个":{"docs":{},"节":{"docs":{},"点":{"docs":{},"需":{"docs":{},"要":{"docs":{},"启":{"docs":{},"动":{"docs":{},"f":{"docs":{},"l":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"应":{"docs":{},"用":{"docs":{},"来":{"docs":{},"支":{"docs":{},"持":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"。":{"docs":{},"运":{"docs":{},"行":{"docs":{},"p":{"docs":{},"y":{"docs":{},"t":{"docs":{},"h":{"docs":{},"o":{"docs":{},"n":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"镜":{"docs":{},"像":{"docs":{},"之":{"docs":{},"前":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"配":{"docs":{},"置":{"docs":{},"一":{"docs":{},"下":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"源":{"docs":{},"。":{"docs":{},"因":{"docs":{},"为":{"docs":{},"我":{"docs":{},"们":{"docs":{},"在":{"docs":{},"墙":{"docs":{},"内":{"docs":{},",":{"docs":{},"使":{"docs":{},"用":{"docs":{},"原":{"docs":{},"有":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"源":{"docs":{},"速":{"docs":{},"度":{"docs":{},"非":{"docs":{},"常":{"docs":{},"感":{"docs":{},"人":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"将":{"docs":{},"使":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},"在":{"docs":{},"国":{"docs":{},"内":{"docs":{},"的":{"docs":{},"加":{"docs":{},"速":{"docs":{},"器":{"docs":{},"。":{"docs":{},"创":{"docs":{},"建":{"docs":{},"/":{"docs":{},"e":{"docs":{},"t":{"docs":{},"c":{"docs":{},"/":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"/":{"docs":{},"d":{"docs":{},"a":{"docs":{},"e":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},".":{"docs":{},"j":{"docs":{},"s":{"docs":{},"o":{"docs":{},"n":{"docs":{},"文":{"docs":{},"件":{"docs":{},",":{"docs":{},"在":{"docs":{},"其":{"docs":{},"中":{"docs":{},"输":{"docs":{},"入":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},".":{"docs":{},".":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}},"b":{"docs":{},"u":{"docs":{},"i":{"docs":{},"l":{"docs":{},"d":{"docs":{},":":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}},"a":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}},"r":{"docs":{},"o":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}},"g":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"i":{"docs":{},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},"s":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"g":{"docs":{},"i":{"docs":{},"t":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"m":{"docs":{},"/":{"docs":{},"t":{"docs":{},"i":{"docs":{},"k":{"docs":{},"a":{"docs":{},"z":{"docs":{},"y":{"docs":{},"q":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"l":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}},"o":{"docs":{},"g":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"y":{"docs":{},"a":{"docs":{},"r":{"docs":{},"n":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.025}}}}}},"分":{"docs":{},"别":{"docs":{},"配":{"docs":{},"置":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"和":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"。":{"docs":{},"分":{"docs":{},"别":{"docs":{},"需":{"docs":{},"要":{"docs":{},"对":{"docs":{},"部":{"docs":{},"署":{"docs":{},"后":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"地":{"docs":{},"址":{"docs":{},"以":{"docs":{},"及":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"地":{"docs":{},"址":{"docs":{},"进":{"docs":{},"行":{"docs":{},"配":{"docs":{},"置":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"页":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}},"启":{"docs":{},"动":{"docs":{},"服":{"docs":{},"务":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"拉":{"docs":{},"取":{"docs":{},"代":{"docs":{},"码":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"构":{"docs":{},"建":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"完":{"docs":{},"成":{"docs":{},"后":{"docs":{},",":{"docs":{},"会":{"docs":{},"在":{"docs":{},".":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},"创":{"docs":{},"建":{"docs":{},"一":{"docs":{},"个":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"文":{"docs":{},"件":{"docs":{},"夹":{"docs":{},",":{"docs":{},"里":{"docs":{},"面":{"docs":{},"是":{"docs":{},"打":{"docs":{},"包":{"docs":{},"好":{"docs":{},"后":{"docs":{},"的":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"添":{"docs":{},"加":{"docs":{},"/":{"docs":{},"e":{"docs":{},"t":{"docs":{},"c":{"docs":{},"/":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},".":{"docs":{},"d":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"文":{"docs":{},"件":{"docs":{},",":{"docs":{},"输":{"docs":{},"入":{"docs":{},"以":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"完":{"docs":{},"成":{"docs":{},"后":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"刚":{"docs":{},"刚":{"docs":{},"添":{"docs":{},"加":{"docs":{},"的":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"出":{"docs":{},"现":{"docs":{},"了":{"docs":{},"在":{"docs":{},"最":{"docs":{},"下":{"docs":{},"方":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"查":{"docs":{},"看":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}},"然":{"docs":{},"后":{"docs":{},"在":{"docs":{},"浏":{"docs":{},"览":{"docs":{},"器":{"docs":{},"中":{"docs":{},"输":{"docs":{},"入":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"界":{"docs":{},"面":{"docs":{},"了":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}},",":{"docs":{},"在":{"docs":{},"侧":{"docs":{},"边":{"docs":{},"栏":{"docs":{},"点":{"docs":{},"击":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"添":{"docs":{},"加":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"选":{"docs":{},"择":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"上":{"docs":{},"传":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"选":{"docs":{},"择":{"docs":{},"刚":{"docs":{},"刚":{"docs":{},"打":{"docs":{},"包":{"docs":{},"好":{"docs":{},"的":{"docs":{},"z":{"docs":{},"i":{"docs":{},"p":{"docs":{},"文":{"docs":{},"件":{"docs":{},"。":{"docs":{},"上":{"docs":{},"传":{"docs":{},"成":{"docs":{},"功":{"docs":{},"后":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},"会":{"docs":{},"出":{"docs":{},"现":{"docs":{},"新":{"docs":{},"添":{"docs":{},"加":{"docs":{},"的":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"。":{"docs":{},"这":{"docs":{},"样":{"docs":{},"就":{"docs":{},"算":{"docs":{},"添":{"docs":{},"加":{"docs":{},"好":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"会":{"docs":{},"提":{"docs":{},"示":{"docs":{},"任":{"docs":{},"务":{"docs":{},"已":{"docs":{},"经":{"docs":{},"派":{"docs":{},"发":{"docs":{},"到":{"docs":{},"队":{"docs":{},"列":{"docs":{},"中":{"docs":{},"去":{"docs":{},"了":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"你":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"左":{"docs":{},"侧":{"docs":{},"看":{"docs":{},"到":{"docs":{},"新":{"docs":{},"创":{"docs":{},"建":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"点":{"docs":{},"击":{"docs":{},"创":{"docs":{},"建":{"docs":{},"时":{"docs":{},"间":{"docs":{},"可":{"docs":{},"以":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"现":{"docs":{},"在":{"docs":{},",":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"启":{"docs":{},"动":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"服":{"docs":{},"务":{"docs":{},"就":{"docs":{},"完":{"docs":{},"成":{"docs":{},"了":{"docs":{},"启":{"docs":{},"动":{"docs":{},"前":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}},"配":{"docs":{},"置":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667},"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}},"该":{"docs":{},"模":{"docs":{},"式":{"docs":{},"同":{"docs":{},"样":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"3":{"docs":{},"个":{"docs":{},"后":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"和":{"1":{"docs":{},"个":{"docs":{},"前":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{},"前":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"是":{"docs":{},"通":{"docs":{},"过":{"docs":{},"n":{"docs":{},"p":{"docs":{},"m":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}}}}}}}}}}},"docs":{}}}}}}}},"docs":{}}}}}}}}},"任":{"docs":{},"务":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Task/":{"ref":"Usage/Task/","tf":10.166666666666666},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"指":{"docs":{},"某":{"docs":{},"一":{"docs":{},"次":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"任":{"docs":{},"务":{"docs":{},"或":{"docs":{},"采":{"docs":{},"集":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"任":{"docs":{},"务":{"docs":{},"与":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"关":{"docs":{},"联":{"docs":{},",":{"docs":{},"其":{"docs":{},"执":{"docs":{},"行":{"docs":{},"的":{"docs":{},"也":{"docs":{},"是":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"指":{"docs":{},"定":{"docs":{},"的":{"docs":{},"执":{"docs":{},"行":{"docs":{},"命":{"docs":{},"令":{"docs":{},"或":{"docs":{},"采":{"docs":{},"集":{"docs":{},"规":{"docs":{},"则":{"docs":{},"。":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"或":{"docs":{},"采":{"docs":{},"集":{"docs":{},"的":{"docs":{},"结":{"docs":{},"果":{"docs":{},"与":{"docs":{},"任":{"docs":{},"务":{"docs":{},"关":{"docs":{},"联":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"可":{"docs":{},"以":{"docs":{},"查":{"docs":{},"看":{"docs":{},"到":{"docs":{},"每":{"docs":{},"一":{"docs":{},"次":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"结":{"docs":{},"果":{"docs":{},"集":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"是":{"docs":{},"整":{"docs":{},"个":{"docs":{},"采":{"docs":{},"集":{"docs":{},"流":{"docs":{},"程":{"docs":{},"的":{"docs":{},"核":{"docs":{},"心":{"docs":{},",":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"的":{"docs":{},"过":{"docs":{},"程":{"docs":{},"都":{"docs":{},"是":{"docs":{},"跟":{"docs":{},"任":{"docs":{},"务":{"docs":{},"关":{"docs":{},"联":{"docs":{},"起":{"docs":{},"来":{"docs":{},"的":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"任":{"docs":{},"务":{"docs":{},"对":{"docs":{},"于":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"来":{"docs":{},"说":{"docs":{},"非":{"docs":{},"常":{"docs":{},"重":{"docs":{},"要":{"docs":{},"。":{"docs":{},"任":{"docs":{},"务":{"docs":{},"被":{"docs":{},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},"触":{"docs":{},"发":{"docs":{},",":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"通":{"docs":{},"过":{"docs":{},"任":{"docs":{},"务":{"docs":{},"队":{"docs":{},"列":{"docs":{},"接":{"docs":{},"收":{"docs":{},"任":{"docs":{},"务":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"在":{"docs":{},"其":{"docs":{},"所":{"docs":{},"在":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},"执":{"docs":{},"行":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Task/":{"ref":"Usage/Task/","tf":0.16666666666666666}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"列":{"docs":{},"表":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}},"日":{"docs":{},"志":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}},"结":{"docs":{},"果":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}},"被":{"docs":{},"触":{"docs":{},"发":{"docs":{},"并":{"docs":{},"被":{"docs":{},"节":{"docs":{},"点":{"docs":{},"执":{"docs":{},"行":{"docs":{},"。":{"docs":{},"用":{"docs":{},"户":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"面":{"docs":{},"中":{"docs":{},"看":{"docs":{},"到":{"docs":{},"任":{"docs":{},"务":{"docs":{},"到":{"docs":{},"状":{"docs":{},"态":{"docs":{},"、":{"docs":{},"日":{"docs":{},"志":{"docs":{},"和":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"结":{"docs":{},"果":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"使":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Usage/":{"ref":"Usage/","tf":10}}}}}}}}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":10.071428571428571}},"触":{"docs":{},"发":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.18181818181818182}},"是":{"docs":{},"比":{"docs":{},"较":{"docs":{},"常":{"docs":{},"用":{"docs":{},"的":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"对":{"docs":{},"于":{"docs":{},"增":{"docs":{},"量":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"或":{"docs":{},"对":{"docs":{},"实":{"docs":{},"时":{"docs":{},"性":{"docs":{},"有":{"docs":{},"要":{"docs":{},"求":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"很":{"docs":{},"重":{"docs":{},"要":{"docs":{},"。":{"docs":{},"这":{"docs":{},"在":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"中":{"docs":{},"会":{"docs":{},"详":{"docs":{},"细":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"。":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"列":{"docs":{},"表":{"docs":{},"会":{"docs":{},"进":{"docs":{},"行":{"docs":{},"更":{"docs":{},"新":{"docs":{},"。":{"docs":{},"每":{"docs":{},"一":{"docs":{},"次":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"更":{"docs":{},"新":{"docs":{},"、":{"docs":{},"删":{"docs":{},"除":{"docs":{},"、":{"docs":{},"创":{"docs":{},"建":{"docs":{},",":{"docs":{},"以":{"docs":{},"及":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"更":{"docs":{},"新":{"docs":{},"、":{"docs":{},"删":{"docs":{},"除":{"docs":{},"、":{"docs":{},"创":{"docs":{},"建":{"docs":{},",":{"docs":{},"都":{"docs":{},"会":{"docs":{},"触":{"docs":{},"发":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"列":{"docs":{},"表":{"docs":{},"的":{"docs":{},"更":{"docs":{},"新":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"指":{"docs":{},"定":{"docs":{},"某":{"docs":{},"个":{"docs":{},"时":{"docs":{},"刻":{"docs":{},",":{"docs":{},"重":{"docs":{},"复":{"docs":{},"性":{"docs":{},"地":{"docs":{},"执":{"docs":{},"行":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},",":{"docs":{},"英":{"docs":{},"文":{"docs":{},"叫":{"docs":{},"做":{"docs":{},"p":{"docs":{},"e":{"docs":{},"r":{"docs":{},"i":{"docs":{},"o":{"docs":{},"d":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Spider/":{"ref":"Usage/Spider/","tf":10.142857142857142},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"就":{"docs":{},"是":{"docs":{},"我":{"docs":{},"们":{"docs":{},"通":{"docs":{},"常":{"docs":{},"说":{"docs":{},"的":{"docs":{},"网":{"docs":{},"络":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},",":{"docs":{},"本":{"docs":{},"小":{"docs":{},"节":{"docs":{},"将":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},":":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}},"最":{"docs":{},"开":{"docs":{},"始":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"的":{"docs":{},"网":{"docs":{},"址":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}},"源":{"docs":{},"代":{"docs":{},"码":{"docs":{},"或":{"docs":{},"配":{"docs":{},"置":{"docs":{},"规":{"docs":{},"则":{"docs":{},"储":{"docs":{},"存":{"docs":{},"在":{"docs":{},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},"上":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"被":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"各":{"docs":{},"个":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"节":{"docs":{},"点":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Node/":{"ref":"Usage/Node/","tf":10.25},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"中":{"docs":{},"的":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"。":{"docs":{},"一":{"docs":{},"个":{"docs":{},"节":{"docs":{},"点":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"会":{"docs":{},"连":{"docs":{},"接":{"docs":{},"到":{"docs":{},"一":{"docs":{},"个":{"docs":{},"任":{"docs":{},"务":{"docs":{},"队":{"docs":{},"列":{"docs":{},"(":{"docs":{},"例":{"docs":{},"如":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},")":{"docs":{},"来":{"docs":{},"接":{"docs":{},"收":{"docs":{},"和":{"docs":{},"运":{"docs":{},"行":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"需":{"docs":{},"要":{"docs":{},"在":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"被":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},",":{"docs":{},"用":{"docs":{},"户":{"docs":{},"在":{"docs":{},"部":{"docs":{},"署":{"docs":{},"前":{"docs":{},"需":{"docs":{},"要":{"docs":{},"定":{"docs":{},"义":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},"和":{"docs":{},"端":{"docs":{},"口":{"docs":{},"(":{"docs":{},"默":{"docs":{},"认":{"docs":{},"为":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},")":{"docs":{},"。":{"docs":{"Usage/Node/":{"ref":"Usage/Node/","tf":0.25}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"修":{"docs":{},"改":{"docs":{},"节":{"docs":{},"点":{"docs":{},"信":{"docs":{},"息":{"docs":{"Usage/Node/":{"ref":"Usage/Node/","tf":0.25},"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":10.25}}}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}},"点":{"docs":{},"击":{"docs":{},"侧":{"docs":{},"边":{"docs":{},"栏":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"节":{"docs":{},"点":{"docs":{},"列":{"docs":{},"表":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"已":{"docs":{},"上":{"docs":{},"线":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"。":{"docs":{},"这":{"docs":{},"里":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"已":{"docs":{},"经":{"docs":{},"运":{"docs":{},"行":{"docs":{},"起":{"docs":{},"来":{"docs":{},"的":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"i":{"docs":{"Usage/Node/View.html":{"ref":"Usage/Node/View.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"任":{"docs":{},"务":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"任":{"docs":{},"务":{"docs":{},"列":{"docs":{},"表":{"docs":{},"。":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"最":{"docs":{},"近":{"docs":{},"的":{"1":{"0":{"docs":{},"个":{"docs":{},"生":{"docs":{},"成":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"可":{"docs":{},"以":{"docs":{},"根":{"docs":{},"据":{"docs":{},"节":{"docs":{},"点":{"docs":{},"、":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"来":{"docs":{},"过":{"docs":{},"滤":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}},"保":{"docs":{},"存":{"docs":{},"、":{"docs":{},"预":{"docs":{},"览":{"docs":{},",":{"docs":{},"查":{"docs":{},"看":{"docs":{},"预":{"docs":{},"览":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}},"配":{"docs":{},"置":{"docs":{},"标":{"docs":{},"签":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"配":{"docs":{},"置":{"docs":{},"页":{"docs":{},"面":{"docs":{},"。":{"docs":{},"接":{"docs":{},"下":{"docs":{},"来":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"对":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"规":{"docs":{},"则":{"docs":{},"进":{"docs":{},"行":{"docs":{},"配":{"docs":{},"置":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"的":{"docs":{},"查":{"docs":{},"看":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"该":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}}}}}}}}}}}}}}}}}}}}},"日":{"docs":{},"志":{"docs":{},"标":{"docs":{},"签":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"查":{"docs":{},"看":{"docs":{},"任":{"docs":{},"务":{"docs":{},"日":{"docs":{},"志":{"docs":{},"。":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}}}}}}}}}}}}}},"结":{"docs":{},"果":{"docs":{},"标":{"docs":{},"签":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"查":{"docs":{},"看":{"docs":{},"任":{"docs":{},"务":{"docs":{},"结":{"docs":{},"果":{"docs":{},"。":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}}}}}}}}}}}}}},"添":{"docs":{},"加":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},",":{"docs":{},"弹":{"docs":{},"出":{"docs":{},"创":{"docs":{},"建":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"弹":{"docs":{},"框":{"docs":{},"。":{"docs":{},"填":{"docs":{},"写":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"内":{"docs":{},"容":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"提":{"docs":{},"交":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"创":{"docs":{},"建":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"在":{"docs":{},"右":{"docs":{},"侧":{"docs":{},"分":{"docs":{},"别":{"docs":{},"输":{"docs":{},"入":{"docs":{},"该":{"docs":{},"节":{"docs":{},"点":{"docs":{},"对":{"docs":{},"应":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"i":{"docs":{},"p":{"docs":{},"和":{"docs":{},"节":{"docs":{},"点":{"docs":{},"端":{"docs":{},"口":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"点":{"docs":{},"击":{"docs":{},"保":{"docs":{},"存":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"保":{"docs":{},"存":{"docs":{},"该":{"docs":{},"节":{"docs":{},"点":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":0.25}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"中":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"配":{"docs":{},"置":{"docs":{},"一":{"docs":{},"下":{"docs":{},"执":{"docs":{},"行":{"docs":{},"命":{"docs":{},"令":{"docs":{},"(":{"docs":{},"运":{"docs":{},"行":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"时":{"docs":{},"后":{"docs":{},"台":{"docs":{},"执":{"docs":{},"行":{"docs":{},"的":{"docs":{},"s":{"docs":{},"h":{"docs":{},"e":{"docs":{},"l":{"docs":{},"l":{"docs":{},"命":{"docs":{},"令":{"docs":{},")":{"docs":{},"和":{"docs":{},"结":{"docs":{},"果":{"docs":{},"集":{"docs":{},"(":{"docs":{},"通":{"docs":{},"过":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"l":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"传":{"docs":{},"递":{"docs":{},"给":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"程":{"docs":{},"序":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"程":{"docs":{},"序":{"docs":{},"存":{"docs":{},"储":{"docs":{},"结":{"docs":{},"果":{"docs":{},"的":{"docs":{},"地":{"docs":{},"方":{"docs":{},")":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"点":{"docs":{},"击":{"docs":{},"保":{"docs":{},"存":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"保":{"docs":{},"存":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"上":{"docs":{},"传":{"docs":{},"之":{"docs":{},"前":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"将":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"文":{"docs":{},"件":{"docs":{},"打":{"docs":{},"包":{"docs":{},"成":{"docs":{},"z":{"docs":{},"i":{"docs":{},"p":{"docs":{},"格":{"docs":{},"式":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"侧":{"docs":{},"边":{"docs":{},"栏":{"docs":{},"点":{"docs":{},"击":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"添":{"docs":{},"加":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}},"检":{"docs":{},"查":{"docs":{},"完":{"docs":{},"目":{"docs":{},"标":{"docs":{},"网":{"docs":{},"页":{"docs":{},"的":{"docs":{},"元":{"docs":{},"素":{"docs":{},"c":{"docs":{},"s":{"docs":{},"s":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"输":{"docs":{},"入":{"docs":{},"列":{"docs":{},"表":{"docs":{},"项":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{},"、":{"docs":{},"开":{"docs":{},"始":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"、":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},"/":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"等":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{},"注":{"docs":{},"意":{"docs":{},"勾":{"docs":{},"选":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"为":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},"点":{"docs":{},"击":{"docs":{},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"的":{"docs":{},"部":{"docs":{},"署":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"将":{"docs":{},"指":{"docs":{},"定":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"所":{"docs":{},"有":{"docs":{},"在":{"docs":{},"线":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},";":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}},"部":{"docs":{},"署":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"将":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"所":{"docs":{},"有":{"docs":{},"在":{"docs":{},"线":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},";":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"点":{"docs":{},"击":{"docs":{},"运":{"docs":{},"行":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"或":{"docs":{},"者":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}},"详":{"docs":{},"情":{"docs":{},"的":{"docs":{},"概":{"docs":{},"览":{"docs":{},"标":{"docs":{},"签":{"docs":{},"中":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"部":{"docs":{},"署":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"将":{"docs":{},"指":{"docs":{},"定":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"所":{"docs":{},"有":{"docs":{},"在":{"docs":{},"线":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},"。":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"中":{"docs":{},"概":{"docs":{},"览":{"docs":{},"标":{"docs":{},"签":{"docs":{},"下":{"docs":{},"点":{"docs":{},"击":{"docs":{},"运":{"docs":{},"行":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"或":{"docs":{},"者":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}},"运":{"docs":{},"行":{"docs":{},"了":{"docs":{},"一":{"docs":{},"段":{"docs":{},"时":{"docs":{},"间":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"会":{"docs":{},"积":{"docs":{},"累":{"docs":{},"一":{"docs":{},"些":{"docs":{},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"运":{"docs":{},"行":{"docs":{},"成":{"docs":{},"功":{"docs":{},"率":{"docs":{},"、":{"docs":{},"任":{"docs":{},"务":{"docs":{},"数":{"docs":{},"、":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"长":{"docs":{},"等":{"docs":{},"指":{"docs":{},"标":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"将":{"docs":{},"这":{"docs":{},"些":{"docs":{},"指":{"docs":{},"标":{"docs":{},"汇":{"docs":{},"总":{"docs":{},"并":{"docs":{},"呈":{"docs":{},"现":{"docs":{},"给":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"。":{"docs":{"Usage/Spider/Analytics.html":{"ref":"Usage/Spider/Analytics.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"任":{"docs":{},"务":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"中":{"docs":{},"的":{"docs":{},"删":{"docs":{},"除":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"确":{"docs":{},"认":{"docs":{},"删":{"docs":{},"除":{"docs":{},"该":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":0.16666666666666666}}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"中":{"docs":{},",":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"是":{"docs":{},"通":{"docs":{},"过":{"docs":{},"a":{"docs":{},"p":{"docs":{},"s":{"docs":{},"c":{"docs":{},"h":{"docs":{},"e":{"docs":{},"d":{"docs":{},"u":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"来":{"docs":{},"实":{"docs":{},"现":{"docs":{},"的":{"docs":{},"。":{"docs":{},"创":{"docs":{},"建":{"docs":{},"一":{"docs":{},"个":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"会":{"docs":{},"在":{"docs":{},"名":{"docs":{},"为":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"的":{"docs":{},"j":{"docs":{},"o":{"docs":{},"b":{"docs":{},"s":{"docs":{},"t":{"docs":{},"o":{"docs":{},"r":{"docs":{},"e":{"docs":{},"中":{"docs":{},"创":{"docs":{},"建":{"docs":{},"一":{"docs":{},"个":{"docs":{},"p":{"docs":{},"e":{"docs":{},"r":{"docs":{},"i":{"docs":{},"o":{"docs":{},"d":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"创":{"docs":{},"建":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":10.2}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2},"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":10.03225806451613}},"是":{"docs":{},"版":{"docs":{},"本":{"docs":{},"v":{"0":{"docs":{},".":{"2":{"docs":{},".":{"1":{"docs":{},"开":{"docs":{},"发":{"docs":{},"的":{"docs":{},"功":{"docs":{},"能":{"docs":{},"。":{"docs":{},"目":{"docs":{},"的":{"docs":{},"是":{"docs":{},"将":{"docs":{},"具":{"docs":{},"有":{"docs":{},"相":{"docs":{},"似":{"docs":{},"网":{"docs":{},"站":{"docs":{},"结":{"docs":{},"构":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"化":{"docs":{},",":{"docs":{},"将":{"docs":{},"开":{"docs":{},"发":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"过":{"docs":{},"程":{"docs":{},"流":{"docs":{},"程":{"docs":{},"化":{"docs":{},",":{"docs":{},"大":{"docs":{},"大":{"docs":{},"提":{"docs":{},"高":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"开":{"docs":{},"发":{"docs":{},"效":{"docs":{},"率":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}},"docs":{}}},"docs":{}}}}}}}}}},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Analytics.html":{"ref":"Usage/Spider/Analytics.html","tf":10.333333333333334}}}}}},"部":{"docs":{},"署":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":10.142857142857142}},"很":{"docs":{},"简":{"docs":{},"单":{"docs":{},",":{"docs":{},"有":{"docs":{},"三":{"docs":{},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}},"好":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"运":{"docs":{},"行":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2},"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":10.066666666666666}},"是":{"docs":{},"指":{"docs":{},"用":{"docs":{},"户":{"docs":{},"可":{"docs":{},"以":{"docs":{},"添":{"docs":{},"加":{"docs":{},"的":{"docs":{},"任":{"docs":{},"何":{"docs":{},"语":{"docs":{},"言":{"docs":{},"任":{"docs":{},"何":{"docs":{},"框":{"docs":{},"架":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"高":{"docs":{},"度":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"化":{"docs":{},"。":{"docs":{},"当":{"docs":{},"用":{"docs":{},"户":{"docs":{},"添":{"docs":{},"加":{"docs":{},"好":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"将":{"docs":{},"其":{"docs":{},"集":{"docs":{},"成":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"的":{"docs":{},"系":{"docs":{},"统":{"docs":{},"中":{"docs":{},"来":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"的":{"docs":{},"添":{"docs":{},"加":{"docs":{},"有":{"docs":{},"两":{"docs":{},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}},"接":{"docs":{},"下":{"docs":{},"来":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"部":{"docs":{},"署":{"docs":{},"、":{"docs":{},"运":{"docs":{},"行":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"上":{"docs":{},"传":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}},"创":{"docs":{},"建":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}},"添":{"docs":{},"加":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}},"&":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.06451612903225806}}},"仅":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},"。":{"docs":{},"这":{"docs":{},"也":{"docs":{},"是":{"docs":{},"最":{"docs":{},"简":{"docs":{},"单":{"docs":{},"的":{"docs":{},"形":{"docs":{},"式":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"列":{"docs":{},"表":{"docs":{},"上":{"docs":{},"的":{"docs":{},"列":{"docs":{},"表":{"docs":{},"项":{"docs":{},",":{"docs":{},"将":{"docs":{},"数":{"docs":{},"据":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"下":{"docs":{},"来":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"只":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}},"列":{"docs":{},"表":{"docs":{},"+":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"先":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},",":{"docs":{},"将":{"docs":{},"列":{"docs":{},"表":{"docs":{},"项":{"docs":{},"中":{"docs":{},"的":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"地":{"docs":{},"址":{"docs":{},"提":{"docs":{},"取":{"docs":{},"出":{"docs":{},"来":{"docs":{},"并":{"docs":{},"跟":{"docs":{},"进":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"页":{"docs":{},"字":{"docs":{},"段":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}},"项":{"docs":{},"的":{"docs":{},"匹":{"docs":{},"和":{"docs":{},"分":{"docs":{},"页":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"的":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"查":{"docs":{},"询":{"docs":{},",":{"docs":{},"由":{"docs":{},"c":{"docs":{},"s":{"docs":{},"s":{"docs":{},"或":{"docs":{},"x":{"docs":{},"p":{"docs":{},"a":{"docs":{},"t":{"docs":{},"h":{"docs":{},"来":{"docs":{},"进":{"docs":{},"行":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}},"开":{"docs":{},"始":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}},"抓":{"docs":{},"取":{"docs":{},"类":{"docs":{},"别":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"字":{"docs":{},"段":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}},"输":{"docs":{},"入":{"docs":{},"完":{"docs":{},"基":{"docs":{},"本":{"docs":{},"信":{"docs":{},"息":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"添":{"docs":{},"加":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}},"遵":{"docs":{},"守":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},"协":{"docs":{},"议":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}},"手":{"docs":{},"动":{"docs":{},"触":{"docs":{},"发":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.18181818181818182}}}}}},"要":{"docs":{},"查":{"docs":{},"看":{"docs":{},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{},"的":{"docs":{},"话":{"docs":{},",":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"在":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"中":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"分":{"docs":{},"析":{"docs":{},"标":{"docs":{},"签":{"docs":{},",":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/Analytics.html":{"ref":"Usage/Spider/Analytics.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"操":{"docs":{},"作":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Task/":{"ref":"Usage/Task/","tf":0.16666666666666666},"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":10.166666666666666}}}}}},"停":{"docs":{},"止":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":0.16666666666666666}}}}}},"删":{"docs":{},"除":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":0.16666666666666666}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"需":{"docs":{},"要":{"docs":{},"停":{"docs":{},"止":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"停":{"docs":{},"止":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"来":{"docs":{},"终":{"docs":{},"止":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":0.16666666666666666}}}}}}}}}}}}}}}}}}}}}}}}}}},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"结":{"docs":{},"果":{"docs":{},"标":{"docs":{},"签":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"下":{"docs":{},"载":{"docs":{},"c":{"docs":{},"s":{"docs":{},"v":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"等":{"docs":{},"待":{"docs":{},"一":{"docs":{},"会":{"docs":{},"儿":{"docs":{},",":{"docs":{},"结":{"docs":{},"果":{"docs":{},"就":{"docs":{},"会":{"docs":{},"以":{"docs":{},"c":{"docs":{},"s":{"docs":{},"v":{"docs":{},"的":{"docs":{},"形":{"docs":{},"式":{"docs":{},"下":{"docs":{},"载":{"docs":{},"到":{"docs":{},"本":{"docs":{},"地":{"docs":{},"。":{"docs":{"Usage/Task/DownloadResults.html":{"ref":"Usage/Task/DownloadResults.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"页":{"docs":{},"面":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"列":{"docs":{},"表":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}},"点":{"docs":{},"击":{"docs":{},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"的":{"docs":{},"修":{"docs":{},"改":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"弹":{"docs":{},"出":{"docs":{},"修":{"docs":{},"改":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"弹":{"docs":{},"框":{"docs":{},"。":{"docs":{},"填":{"docs":{},"写":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"内":{"docs":{},"容":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"提":{"docs":{},"交":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"修":{"docs":{},"改":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"删":{"docs":{},"除":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"确":{"docs":{},"认":{"docs":{},"删":{"docs":{},"除":{"docs":{},"该":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"结":{"docs":{},"果":{"docs":{},"储":{"docs":{},"存":{"docs":{},"在":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"中":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"有":{"docs":{},"时":{"docs":{},"候":{"docs":{},"需":{"docs":{},"要":{"docs":{},"将":{"docs":{},"其":{"docs":{},"导":{"docs":{},"出":{"docs":{},",":{"docs":{},"这":{"docs":{},"时":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"界":{"docs":{},"面":{"docs":{},"中":{"docs":{},"进":{"docs":{},"行":{"docs":{},"导":{"docs":{},"出":{"docs":{},"操":{"docs":{},"作":{"docs":{},"。":{"docs":{"Usage/Task/DownloadResults.html":{"ref":"Usage/Task/DownloadResults.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"j":{"docs":{},"o":{"docs":{},"b":{"docs":{},",":{"docs":{},"a":{"docs":{},"p":{"docs":{},"s":{"docs":{},"c":{"docs":{},"h":{"docs":{},"e":{"docs":{},"d":{"docs":{},"u":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"调":{"docs":{},"度":{"docs":{},"引":{"docs":{},"擎":{"docs":{},"将":{"docs":{},"会":{"docs":{},"不":{"docs":{},"断":{"docs":{},"的":{"docs":{},"去":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"中":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"执":{"docs":{},"行":{"docs":{},"时":{"docs":{},"间":{"docs":{},",":{"docs":{},"如":{"docs":{},"果":{"docs":{},"执":{"docs":{},"行":{"docs":{},"时":{"docs":{},"间":{"docs":{},"满":{"docs":{},"足":{"docs":{},"要":{"docs":{},"求":{"docs":{},",":{"docs":{},"则":{"docs":{},"会":{"docs":{},"在":{"docs":{},"后":{"docs":{},"台":{"docs":{},"触":{"docs":{},"发":{"docs":{},"一":{"docs":{},"次":{"docs":{},"任":{"docs":{},"务":{"docs":{},"运":{"docs":{},"行":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"u":{"docs":{},"e":{"docs":{},"j":{"docs":{},"i":{"docs":{},"n":{"docs":{},"p":{"docs":{},"i":{"docs":{},"p":{"docs":{},"e":{"docs":{},"l":{"docs":{},"i":{"docs":{},"n":{"docs":{},"e":{"docs":{},"(":{"docs":{},"o":{"docs":{},"b":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},")":{"docs":{},":":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}}}}}}},"网":{"docs":{},"站":{"docs":{"Usage/Site/":{"ref":"Usage/Site/","tf":10.5}},"信":{"docs":{},"息":{"docs":{},"是":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"用":{"docs":{},"户":{"docs":{},"查":{"docs":{},"看":{"docs":{},"站":{"docs":{},"长":{"docs":{},"之":{"docs":{},"家":{"docs":{},"收":{"docs":{},"录":{"docs":{},"网":{"docs":{},"站":{"docs":{},"的":{"docs":{},"信":{"docs":{},"息":{"docs":{},"的":{"docs":{},",":{"docs":{},"包":{"docs":{},"含":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},"协":{"docs":{},"议":{"docs":{},"、":{"docs":{},"首":{"docs":{},"页":{"docs":{},"响":{"docs":{},"应":{"docs":{},"等":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{"Usage/Site/":{"ref":"Usage/Site/","tf":0.5}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"一":{"docs":{},"个":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"的":{"docs":{},"插":{"docs":{},"件":{"docs":{},",":{"docs":{},"用":{"docs":{},"于":{"docs":{},"监":{"docs":{},"控":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"节":{"docs":{},"点":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}},"中":{"docs":{},"间":{"docs":{},"者":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"跟":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"中":{"docs":{},"定":{"docs":{},"义":{"docs":{},"的":{"docs":{},"一":{"docs":{},"样":{"docs":{},",":{"docs":{},"作":{"docs":{},"为":{"docs":{},"运":{"docs":{},"行":{"docs":{},"异":{"docs":{},"步":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"队":{"docs":{},"列":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"架":{"docs":{},"构":{"docs":{"Architecture/":{"ref":"Architecture/","tf":10.037037037037036}}}},"与":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"集":{"docs":{},"成":{"docs":{"Examples/":{"ref":"Examples/","tf":0.5},"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":10.020408163265307}}}}}}}}}}},"样":{"docs":{},"例":{"docs":{"Examples/":{"ref":"Examples/","tf":10.5}}}},"=":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.1836734693877551}}},"o":{"docs":{},"s":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},"i":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},".":{"docs":{},"g":{"docs":{},"e":{"docs":{},"t":{"docs":{},"(":{"docs":{},"'":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"l":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"'":{"docs":{},")":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"'":{"docs":{},")":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"以":{"docs":{},"下":{"docs":{},"是":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"跟":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"集":{"docs":{},"成":{"docs":{},"的":{"docs":{},"例":{"docs":{},"子":{"docs":{},",":{"docs":{},"利":{"docs":{},"用":{"docs":{},"了":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"传":{"docs":{},"过":{"docs":{},"来":{"docs":{},"的":{"docs":{},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"和":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"l":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{},"。":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"length":384},"corpusTokens":["\"27017:27017\"","\"6379:6379\"","\"8000:8000\"","\"8001:8000\"","\"8002:8000\"","\"8080:8080\"","\"registri","#","&","'192.168.99.100'","'3.3'","'crawlab_test'","'test'","../crawlab","../frontend","/bin/sh","/home/yeqing/.env.production.master:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production:/opt/crawlab/frontend/.env.product","/home/yeqing/config.master.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/jenkins_home/workspace/crawlab_develop/frontend/dist;","/opt/crawlab/docker_init.sh","16.04是以下命令。","27017","27017:27017","30秒的时间来build前端静态文件,之后就可以打开crawlab界面地址地址看到界面了。界面地址默认为http://localhost:8080。","8000:8000","8080:8080","8080;","=","[\"https://registry.dock","[app]","\\","admin的单页应用。其中重用了很多el","alway","api服务","app","app.pi","app.py来启动应用。","apt","backend","broker","build:prod","cd","class","clone","cn.com\"]","col","col_nam","col_name:","compos","compose.yml后,只需要运行以下命令就可以启动crawlab。","compose.yml定义如下。","compose.yml更改为如下内容。","compose.yml的yaml文件来定义需要启动的容器,可以是单个,也可以(通常)是多个的。crawlab的dock","compose也很简单,大家去网上百度一下就可以了。","compose和定义好dock","compose是一个集群管理方式,可以利用名为dock","compose的方式很适合多节点部署,在原有的master基础上增加几个worker节点,达到多节点部署的目的。将dock","compose的方式来部署。dock","container_name:","crawlab","crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。","crawlab会自动发现project_source_file_folder目录下的所有爬虫目录,并将这些目录生成自定义爬虫并集成到crawlab中。因此,将爬虫项目目录拷贝到project_source_file_folder目录下,就可以添加一个爬虫了。","crawlab允许用户创建两种爬虫:","crawlab是基于celery的分布式爬虫管理平台,可以集成任何语言和任何框架。","crawlab的可配置爬虫是基于scrapy的,因此天生支持并发。而且,可配置爬虫完全支持自定义爬虫的一般功能,因此也支持任务调度、任务监控、日志监控、数据分析。","crawlab的架构跟celery非常相似,但是加入了包括前端、爬虫、flower在内的额外模块,以支持爬虫管理的功能。架构图如下。","crawlab简介","d","db","db[col_name]","def","demo","depends_on:","dev.crawlab.com;","docker","docker安装部署","element","entrypoint:","exampl","flower","flower.pi","frontend","g","git","https://github.com/tikazyq/crawlab","image:","import","index","index.html;","instal","item","item,","item['task_id']","job,apscheduler调度引擎将会不断的去数据库中匹配任务的执行时间,如果执行时间满足要求,则会在后台触发一次任务运行。","juejinpipeline(object):","listen","log","manage.pi","master","master:","mirrors\":","mongo","mongo:","mongo:latest","mongo[mongo_db]","mongo_db","mongo_host","mongo_port","mongocli","mongoclient(host=mongo_host,","mongo一行命令。如何安装docker跟操作系统有关,这里就不展开讲了,需要的同学自行百度一下相关教程。","name","nginx","node","npm","os","os.environ.get('crawlab_collection')","os.environ.get('crawlab_task_id')","p","pip","pipelin","pm2","port=mongo_port)","ports:","process_item(self,","pull","pymongo","python","r","redi","redis:","redis:latest","reload","requir","restart:","return","rm","root","run","scrapi","self.col.save(item)","serv","server","server_nam","serve来进行的,因此是开发者模式。注意:强烈不建议在生产环境中用预览模式。预览模式只是让开发者快速体验crawlab以及调试代码问题的一种方式,而不是用作生产环境部署的。","services:","spider","spider):","start","sudo","task","tasks,在linux中也被称为crontab。定时任务可以让任务可以被执行多次,而用户则不用手动的操作来执行任务。在生产环境中,这非常常见。定时任务对于对增量抓取或对数据实时性有要求的用户来说非常有用。","tikazyq/crawlab","tikazyq/crawlab:latest","ui的控件来支持相应的展示。","up","v","version:","volumns:","worker","worker.pi","worker1:","worker2:","worker,他们通过连接到配置好的broker(通常是redis)来进行与主机的通信。","yarn","{","}","一个celery的插件,用于监控celery节点。","下载结果","下载镜像","与scrapy集成","中间者","中间者跟celery中定义的一样,作为运行异步任务的队列。","仅列表页。这也是最简单的形式,爬虫遍历列表上的列表项,将数据抓取下来。","仅详情页。爬虫只抓取详情页。","以下是crawlab跟scrapy集成的例子,利用了crawlab传过来的task_id和collection_name。","任务","任务其实就是指某一次抓取任务或采集任务。任务与爬虫关联,其执行的也是爬虫指定的执行命令或采集规则。抓取或采集的结果与任务关联,因此可以查看到每一次任务的结果集。crawlab的任务是整个采集流程的核心,抓取的过程都是跟任务关联起来的,因此任务对于crawlab来说非常重要。任务被app触发,worker通过任务队列接收任务,然后在其所在节点上执行任务。","任务列表","任务日志","任务结果","任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。","使用crawlab","修改定时任务","修改节点信息","停止任务","其中,root是静态文件的根目录,这里是npm打包好后的静态文件。","其中,我们映射了8080端口(nginx前端静态文件)以及8000端口(后端api)到宿主机。另外还将前端配置文件/home/yeqing/.env.production和后端配置文件/home/yeqing/config.py映射到了容器相应的目录下。传入参数master是代表该启动方式为主机启动模式,也就是所有服务(前端、api、flower、worker)都会启动。另外一个模式是worker模式,只会启动必要的api和worker服务,这个对于分布式部署比较有用。等待大约20","分别配置前端配置文件./frontend/.env.production和后端配置文件./crawlab/config/config.py。分别需要对部署后api地址以及数据库地址进行配置。","分页选择器","列表+详情页。爬虫先遍历列表页,将列表项中的详情页地址提取出来并跟进抓取详情页。","列表页字段","列表项的匹和分页按钮的匹配查询,由css或xpath来进行匹配。","列表项选择器","创建定时任务","创建爬虫","删除任务","删除定时任务","前端","前端其实就是一个基于vue","前端配置文件","前者可以通过web界面和创建项目目录的方式来添加,后者由于没有源代码,只能通过web界面来添加。","可配置爬虫","可配置爬虫是版本v0.2.1开发的功能。目的是将具有相似网站结构的爬虫项目可配置化,将开发爬虫的过程流程化,大大提高爬虫开发效率。","同样,在浏览器中输入http://localhost:8080就可以看到界面。","后台应用","后端配置文件","后面我们需要让爬虫运行在各个节点上,需要让主机与节点进行通信,因此需要知道节点的ip地址和端口。我们需要手动配置一下节点的ip和端口。在节点列表中点击操作列里的蓝色查看按钮进入到节点详情。节点详情样子如下。","启动服务","在crawlab中,定时任务是通过apscheduler来实现的。创建一个定时任务之后,会在名为mongo的jobstore中创建一个period","在任务列表中,点击操作列中的删除按钮,确认删除该任务。","在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮。","在右侧分别输入该节点对应的节点ip和节点端口,然后点击保存按钮,保存该节点信息。","在定义爬虫中,我们需要配置一下执行命令(运行爬虫时后台执行的shell命令)和结果集(通过crawlab_collection传递给爬虫程序,爬虫程序存储结果的地方),然后点击保存按钮保存爬虫信息。","在检查完目标网页的元素css选择器之后,我们输入列表项选择器、开始url、列表页/详情页等信息。注意勾选url为详情页url。","在爬虫列表中操作列点击运行按钮,或者","在爬虫列表中点击操作列的部署按钮,将指定爬虫部署到所有在线节点中;","在爬虫列表中点击部署所有爬虫,将所有爬虫部署到所有在线节点中;","在爬虫详情中概览标签下点击运行按钮,或者","在爬虫详情的概览标签中,点击部署按钮,将指定爬虫部署到所有在线节点中。","在运行了一段时间之后,爬虫会积累一些统计数据,例如运行成功率、任务数、运行时长等指标。crawlab将这些指标汇总并呈现给开发者。","在通过web界面上传之前,需要将爬虫项目文件打包成zip格式。","基于celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.","多节点模式","安装","安装crawlab","安装docker","安装nginx,在ubuntu","安装前端所需库。","安装后端所需库。","安装完docker","定时任务","定时任务列表会进行更新。每一次爬虫更新、删除、创建,以及定时任务的更新、删除、创建,都会触发定时任务列表的更新。","定时任务是指定某个时刻,重复性地执行的任务,英文叫做period","定时任务触发","定时任务触发是比较常用的功能,对于增量抓取或对实时性有要求的任务很重要。这在定时任务中会详细介绍。","对docker不了解的开发者,可以参考一下这篇文章(9102","对于自定义爬虫,可以在配置标签下点击运行按钮","导航至任务详情,点击结果标签,点击下载csv按钮,等待一会儿,结果就会以csv的形式下载到本地。","导航至定时任务页面,可以看到定时任务的列表。","导航至定时任务页面,点击操作列的修改按钮,弹出修改定时任务的弹框。填写相应的内容,点击提交按钮修改定时任务。","导航至定时任务页面,点击操作列的删除按钮,确认删除该任务。","导航至需要停止的任务的任务详情,点击停止按钮来终止任务。","年了,学点","开始url","当任务运行起来之后,我们因为某个原因可能需要终止任务,这时我们需要在crawlab中停止该任务。","当然,也可以用docker","我们已经在dockerhub上构建了crawlab的镜像,开发者只需要将其pull下来使用。在pul","我们有两种运行爬虫的方式:","手动触发","执行以下命令将crawlab的镜像下载下来。镜像大小大概在几百兆,因此下载需要几分钟时间。","抓取类别","拉取代码","拷贝一份后端配置文件./crawlab/config/config.py以及前端配置文件./frontend/.env.production到某一个地方。例如我的例子,分别为/home/yeqing/config.py和/home/yeqing/.env.production。","接下来,我们就可以部署、运行自定义爬虫了。","操作任务","更改后端配置文件config.py,将mongodb、redis的指向ip更改为自己数据的值。注意,容器中对应的宿主机的ip地址不是localhost,而是172.17.0.1(当然也可以用network来做,只是稍微麻烦一些)。更改前端配置文件.env.production,将api地址vue_app_base_url更改为宿主机所在的ip地址,例如http://192.168.0.8:8000,这将是前端调用api会用到的url。","更改好配置文件之后,接下来就是运行容器了。执行以下命令来启动容器。","更改配置文件","本使用手册会帮助您解决在安装使用crawlab遇到的任何问题。","本小节将介绍三种安装docker的方式:","本小节将介绍以下内容:","本小节将介绍如何使用crawlab,包括如下内容:","构建","构建完成后,会在./frontend目录下创建一个dist文件夹,里面是打包好后的静态文件。","架构","查看任务","查看演示","查看节点","查看节点列表","样例","添加/etc/nginx/conf.d/crawlab.conf文件,输入以下内容。","添加完成后,可以看到刚刚添加的可配置爬虫出现了在最下方,点击查看进入到爬虫详情。","添加爬虫","点击侧边栏的任务导航至任务列表。可以看到最近的10个生成的任务。可以根据节点、爬虫来过滤任务。","点击侧边栏的节点导航至节点列表,可以看到已上线的节点。这里的节点其实就是已经运行起来的celeri","点击保存、预览,查看预览内容。","点击可配置爬虫。","点击操作列的查看按钮,进入到该任务的任务详情。","点击日志标签,可以查看任务日志。","点击添加定时任务,弹出创建定时任务的弹框。填写相应的内容,点击提交按钮创建定时任务。","点击结果标签,可以查看任务结果。","点击配置标签进入到配置页面。接下来,我们需要对爬虫规则进行配置。","然后在浏览器中输入http://localhost:8080就可以看到界面了。","然后,crawlab会提示任务已经派发到队列中去了,然后你可以在爬虫详情左侧看到新创建的任务。点击创建时间可以导航至任务详情。","然后,在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮,选择自定义爬虫,点击上传按钮,选择刚刚打包好的zip文件。上传成功后,爬虫列表中会出现新添加的自定义爬虫。这样就算添加好了。","爬虫","爬虫就是我们通常说的网络爬虫了,本小节将介绍如下内容:","爬虫最开始遍历的网址。","爬虫源代码或配置规则储存在app上,需要被部署到各个worker节点中。","现在,只需要启动nginx服务就完成了启动前端服务。","直接部署","直接部署是之前没有docker时的部署方式,相对于docker部署来说有些繁琐。但了解如何直接部署可以帮助更深入地理解docker是如何构建crawlab镜像的。这里简单介绍一下。","知识)做进一步了解。简单来说,docker可以利用已存在的镜像帮助构建一些常用的服务和应用,例如nginx、mongodb、redis等等。用docker运行一个mongodb服务仅需dock","结果储存在数据库中之后,我们有时候需要将其导出,这时可以在界面中进行导出操作。","统计数据","网站","网站信息是帮助用户查看站长之家收录网站的信息的,包含robots协议、首页响应等信息。","自定义爬虫","自定义爬虫是指用户可以添加的任何语言任何框架的爬虫,高度自定义化。当用户添加好自定义爬虫之后,crawlab就可以将其集成到爬虫管理的系统中来。","自定义爬虫的添加有两种方式:","节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口。","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口(默认为localhost:8000)。","要查看统计数据的话,只需要在爬虫详情中,点击分析标签,就可以看到爬虫的统计数据了。","该模式同样会启动3个后端服务和1个前端服务。前端服务是通过npm","详情页字段","输入完基本信息,点击添加。","运行docker容器","运行爬虫","这个方式稍微有些繁琐,但是对于无法轻松获取服务器的读写权限时是非常有用的,适合在生产环境上使用。","这个默认是开启的。如果开启,爬虫将先抓取网站的robots.txt并判断页面是否可抓;否则,不会对此进行验证。用户可以选择将其关闭。请注意,任何无视robots协议的行为都有法律风险。","这也是爬虫抓取采用的策略,也就是爬虫遍历网页是如何进行的。作为第一个版本,我们有仅列表、仅详情页、列表+详情页。","这些都是再列表页或详情页中需要提取的字段。字段由css选择器或者xpath来匹配提取。可以选择文本或者属性。","这应该是部署应用的最方便也是最节省时间的方式了。在最近的一次版本更新v0.2.3中,我们发布了docker功能,让大家可以利用docker来轻松部署crawlab。下面将一步一步介绍如何使用docker来部署crawlab。","这是一个flask应用,提供了必要的api来支持常规操作,例如crud、爬虫部署以及任务运行。每一个节点需要启动flask应用来支持爬虫部署。运行python","这样的话,pull镜像的速度会比不改变镜像源的速度快很多。","这样,pm2会启动3个守护进程来管理这3个服务。我们如果想看后端服务的日志的话,可以执行以下命令。","这样,我们就完成了节点的配置工作。","这种方式非常方便,但是需要获得主机服务器的读写权限,因而比较适合在开发环境上采用。","这里先定义了master节点,也就是crawlab的主节点。master依赖于mongo和redis容器,因此在启动之前会同时启动mongo和redis容器。这样就不需要单独配置mongo和redis服务了,大大节省了环境配置的时间。","这里启动了多增加了两个worker节点,以worker模式启动。这样,多节点部署,也就是分布式部署就完成了。","这里已经有一些配置好的初始输入项。我们简单介绍一下各自的含义。","这里我们选择列表+详情页。","这里是指启动后端服务。我们用pm2来管理进程。执行以下命令。","这里的cron跟linux中的crontab是一致的。如果对crontab不了解,可以参考这篇文章。","这里的构建是指前端构建,需要执行以下命令。","这里的爬虫部署是指自定义爬虫的部署,因为可配置爬虫已经内嵌到crawlab中了,所有节点都可以使用,不需要额外部署。简单来说,就是将主机上的爬虫源代码通过http的方式打包传输至worker节点上,因此节点就可以运行传输过来的爬虫了。","通过web界面上传","通过web界面上传爬虫","通过创建项目目录","通过添加项目目录","遵守robots协议","部署好之后,我们就可以运行爬虫了。","部署爬虫","部署爬虫很简单,有三种方式:","配置","配置爬虫","镜像之前,我们需要配置一下镜像源。因为我们在墙内,使用原有的镜像源速度非常感人,因此将使用dockerhub在国内的加速器。创建/etc/docker/daemon.json文件,在其中输入如下内容。","项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。","预览模式","预览模式是一种让用户比较快的上手的一种部署模式。跟直接部署类似,但不用经过构建、nginx和启动服务的步骤。在启动时只需要执行以下命令就可以了。相较于直接部署来说方便一些。","首先是将github上的代码拉取到本地。","首先,我们来看如何安装crawlab吧,请查看安装。"],"pipeline":["stopWordFilter","stemmer"]},"store":{"./":{"url":"./","title":"Crawlab简介","keywords":"","body":"Crawlab\n基于Celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.\n查看演示 Demo\nCrawlab是基于Celery的分布式爬虫管理平台,可以集成任何语言和任何框架。\n项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用Crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将Crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。\nCrawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。Crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。\n本使用手册会帮助您解决在安装使用Crawlab遇到的任何问题。\n首先,我们来看如何安装Crawlab吧,请查看安装。\n"},"Installation/":{"url":"Installation/","title":"安装Crawlab","keywords":"","body":"本小节将介绍三种安装Docker的方式:\n\nDocker\n直接部署\n预览模式\n\n"},"Installation/Docker.html":{"url":"Installation/Docker.html","title":"Docker","keywords":"","body":"Docker安装部署\n这应该是部署应用的最方便也是最节省时间的方式了。在最近的一次版本更新v0.2.3中,我们发布了Docker功能,让大家可以利用Docker来轻松部署Crawlab。下面将一步一步介绍如何使用Docker来部署Crawlab。\n对Docker不了解的开发者,可以参考一下这篇文章(9102 年了,学点 Docker 知识)做进一步了解。简单来说,Docker可以利用已存在的镜像帮助构建一些常用的服务和应用,例如Nginx、MongoDB、Redis等等。用Docker运行一个MongoDB服务仅需docker run -d --name mongo -p 27017:27017 mongo一行命令。如何安装Docker跟操作系统有关,这里就不展开讲了,需要的同学自行百度一下相关教程。\n下载镜像\n我们已经在DockerHub上构建了Crawlab的镜像,开发者只需要将其pull下来使用。在pull 镜像之前,我们需要配置一下镜像源。因为我们在墙内,使用原有的镜像源速度非常感人,因此将使用DockerHub在国内的加速器。创建/etc/docker/daemon.json文件,在其中输入如下内容。\n{\n \"registry-mirrors\": [\"https://registry.docker-cn.com\"]\n}\n\n这样的话,pull镜像的速度会比不改变镜像源的速度快很多。\n执行以下命令将Crawlab的镜像下载下来。镜像大小大概在几百兆,因此下载需要几分钟时间。\ndocker pull tikazyq/crawlab:latest\n\n更改配置文件\n拷贝一份后端配置文件./crawlab/config/config.py以及前端配置文件./frontend/.env.production到某一个地方。例如我的例子,分别为/home/yeqing/config.py和/home/yeqing/.env.production。\n更改后端配置文件config.py,将MongoDB、Redis的指向IP更改为自己数据的值。注意,容器中对应的宿主机的IP地址不是localhost,而是172.17.0.1(当然也可以用network来做,只是稍微麻烦一些)。更改前端配置文件.env.production,将API地址VUE_APP_BASE_URL更改为宿主机所在的IP地址,例如http://192.168.0.8:8000,这将是前端调用API会用到的URL。\n运行Docker容器\n更改好配置文件之后,接下来就是运行容器了。执行以下命令来启动容器。\ndocker run -d --rm --name crawlab \\\n -p 8080:8080 \\\n -p 8000:8000 \\\n -v /home/yeqing/.env.production:/opt/crawlab/frontend/.env.production \\\n -v /home/yeqing/config.py:/opt/crawlab/crawlab/config/config.py \\\n tikazyq/crawlab master\n\n其中,我们映射了8080端口(Nginx前端静态文件)以及8000端口(后端API)到宿主机。另外还将前端配置文件/home/yeqing/.env.production和后端配置文件/home/yeqing/config.py映射到了容器相应的目录下。传入参数master是代表该启动方式为主机启动模式,也就是所有服务(前端、Api、Flower、Worker)都会启动。另外一个模式是worker模式,只会启动必要的Api和Worker服务,这个对于分布式部署比较有用。等待大约20-30秒的时间来build前端静态文件,之后就可以打开Crawlab界面地址地址看到界面了。界面地址默认为http://localhost:8080。\n\nDocker-Compose\n当然,也可以用docker-compose的方式来部署。docker-compose是一个集群管理方式,可以利用名为docker-compose.yml的yaml文件来定义需要启动的容器,可以是单个,也可以(通常)是多个的。Crawlab的docker-compose.yml定义如下。\nversion: '3.3'\nservices:\n master: \n image: tikazyq/crawlab:latest\n container_name: crawlab\n volumns:\n - /home/yeqing/config.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports: \n - \"8080:8080\" # nginx\n - \"8000:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - master\n mongo:\n image: mongo:latest\n restart: always\n ports:\n - \"27017:27017\"\n redis:\n image: redis:latest\n restart: always\n ports:\n - \"6379:6379\"\n\n这里先定义了master节点,也就是Crawlab的主节点。master依赖于mongo和redis容器,因此在启动之前会同时启动mongo和redis容器。这样就不需要单独配置mongo和redis服务了,大大节省了环境配置的时间。\n安装docker-compose也很简单,大家去网上百度一下就可以了。\n安装完docker-compose和定义好docker-compose.yml后,只需要运行以下命令就可以启动Crawlab。\ndocker-compose up\n\n同样,在浏览器中输入http://localhost:8080就可以看到界面。\n多节点模式\ndocker-compose的方式很适合多节点部署,在原有的master基础上增加几个worker节点,达到多节点部署的目的。将docker-compose.yml更改为如下内容。\nversion: '3.3'\nservices:\n master: \n image: tikazyq/crawlab:latest\n container_name: crawlab\n volumns:\n - /home/yeqing/config.master.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production.master:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports: \n - \"8080:8080\" # nginx\n - \"8000:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - master\n worker1: \n image: tikazyq/crawlab:latest\n volumns:\n - /home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports:\n - \"8001:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - worker\n worker2: \n image: tikazyq/crawlab:latest\n volumns:\n - /home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports:\n - \"8002:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - worker\n mongo:\n image: mongo:latest\n restart: always\n ports:\n - \"27017:27017\"\n redis:\n image: redis:latest\n restart: always\n ports:\n - \"6379:6379\"\n\n这里启动了多增加了两个worker节点,以worker模式启动。这样,多节点部署,也就是分布式部署就完成了。\n"},"Installation/Direct.html":{"url":"Installation/Direct.html","title":"直接部署","keywords":"","body":"直接部署\n直接部署是之前没有Docker时的部署方式,相对于Docker部署来说有些繁琐。但了解如何直接部署可以帮助更深入地理解Docker是如何构建Crawlab镜像的。这里简单介绍一下。\n拉取代码\n首先是将github上的代码拉取到本地。\ngit clone https://github.com/tikazyq/crawlab\n\n安装\n安装前端所需库。\nnpm install -g yarn pm2\ncd frontend\nyarn install\n\n安装后端所需库。\ncd ../crawlab\npip install -r requirements\n\n配置\n分别配置前端配置文件./frontend/.env.production和后端配置文件./crawlab/config/config.py。分别需要对部署后API地址以及数据库地址进行配置。\n构建\n这里的构建是指前端构建,需要执行以下命令。\ncd ../frontend\nnpm run build:prod\n\n构建完成后,会在./frontend目录下创建一个dist文件夹,里面是打包好后的静态文件。\nNginx\n安装nginx,在ubuntu 16.04是以下命令。\nsudo apt-get install nginx\n\n添加/etc/nginx/conf.d/crawlab.conf文件,输入以下内容。\nserver {\n listen 8080;\n server_name dev.crawlab.com;\n root /home/yeqing/jenkins_home/workspace/crawlab_develop/frontend/dist;\n index index.html;\n}\n其中,root是静态文件的根目录,这里是npm打包好后的静态文件。\n现在,只需要启动nginx服务就完成了启动前端服务。\nnginx reload\n\n启动服务\n这里是指启动后端服务。我们用pm2来管理进程。执行以下命令。\npm2 start app.py # API服务\npm2 start worker.py # Worker\npm2 start flower.py # Flower\n\n这样,pm2会启动3个守护进程来管理这3个服务。我们如果想看后端服务的日志的话,可以执行以下命令。\npm2 logs [app]\n\n然后在浏览器中输入http://localhost:8080就可以看到界面了。\n"},"Installation/Preview.html":{"url":"Installation/Preview.html","title":"预览模式","keywords":"","body":"预览模式\n预览模式是一种让用户比较快的上手的一种部署模式。跟直接部署类似,但不用经过构建、nginx和启动服务的步骤。在启动时只需要执行以下命令就可以了。相较于直接部署来说方便一些。\npython manage.py serve\n\n该模式同样会启动3个后端服务和1个前端服务。前端服务是通过npm run serve来进行的,因此是开发者模式。注意:强烈不建议在生产环境中用预览模式。预览模式只是让开发者快速体验Crawlab以及调试代码问题的一种方式,而不是用作生产环境部署的。\n"},"Usage/":{"url":"Usage/","title":"使用Crawlab","keywords":"","body":"本小节将介绍如何使用Crawlab,包括如下内容:\n\n节点\n爬虫\n任务\n定时任务\n\n"},"Usage/Node/":{"url":"Usage/Node/","title":"节点","keywords":"","body":"节点\n节点其实就是Celery中的Worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口(默认为localhost:8000)。\n\n查看节点\n修改节点信息\n\n"},"Usage/Node/View.html":{"url":"Usage/Node/View.html","title":"查看节点列表","keywords":"","body":"查看节点列表\n点击侧边栏的节点导航至节点列表,可以看到已上线的节点。这里的节点其实就是已经运行起来的celery worker,他们通过连接到配置好的broker(通常是redis)来进行与主机的通信。\n\n"},"Usage/Node/Edit.html":{"url":"Usage/Node/Edit.html","title":"修改节点信息","keywords":"","body":"修改节点信息\n后面我们需要让爬虫运行在各个节点上,需要让主机与节点进行通信,因此需要知道节点的IP地址和端口。我们需要手动配置一下节点的IP和端口。在节点列表中点击操作列里的蓝色查看按钮进入到节点详情。节点详情样子如下。\n\n在右侧分别输入该节点对应的节点IP和节点端口,然后点击保存按钮,保存该节点信息。\n这样,我们就完成了节点的配置工作。\n"},"Usage/Spider/":{"url":"Usage/Spider/","title":"爬虫","keywords":"","body":"爬虫\n爬虫就是我们通常说的网络爬虫了,本小节将介绍如下内容:\n\n创建爬虫\n部署爬虫\n运行爬虫\n可配置爬虫\n统计数据\n\n"},"Usage/Spider/Create.html":{"url":"Usage/Spider/Create.html","title":"创建爬虫","keywords":"","body":"创建爬虫\nCrawlab允许用户创建两种爬虫:\n\n自定义爬虫\n可配置爬虫\n\n前者可以通过Web界面和创建项目目录的方式来添加,后者由于没有源代码,只能通过Web界面来添加。\n"},"Usage/Spider/CustomizedSpider.html":{"url":"Usage/Spider/CustomizedSpider.html","title":"自定义爬虫","keywords":"","body":"自定义爬虫\n自定义爬虫是指用户可以添加的任何语言任何框架的爬虫,高度自定义化。当用户添加好自定义爬虫之后,Crawlab就可以将其集成到爬虫管理的系统中来。\n自定义爬虫的添加有两种方式:\n\n通过Web界面上传爬虫\n通过创建项目目录\n\n通过Web界面上传\n在通过Web界面上传之前,需要将爬虫项目文件打包成zip格式。\n\n然后,在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮,选择自定义爬虫,点击上传按钮,选择刚刚打包好的zip文件。上传成功后,爬虫列表中会出现新添加的自定义爬虫。这样就算添加好了。\n这个方式稍微有些繁琐,但是对于无法轻松获取服务器的读写权限时是非常有用的,适合在生产环境上使用。\n通过添加项目目录\nCrawlab会自动发现PROJECT_SOURCE_FILE_FOLDER目录下的所有爬虫目录,并将这些目录生成自定义爬虫并集成到Crawlab中。因此,将爬虫项目目录拷贝到PROJECT_SOURCE_FILE_FOLDER目录下,就可以添加一个爬虫了。\n这种方式非常方便,但是需要获得主机服务器的读写权限,因而比较适合在开发环境上采用。\n配置爬虫\n在定义爬虫中,我们需要配置一下执行命令(运行爬虫时后台执行的shell命令)和结果集(通过CRAWLAB_COLLECTION传递给爬虫程序,爬虫程序存储结果的地方),然后点击保存按钮保存爬虫信息。\n\n接下来,我们就可以部署、运行自定义爬虫了。\n"},"Usage/Spider/ConfigurableSpider.html":{"url":"Usage/Spider/ConfigurableSpider.html","title":"可配置爬虫","keywords":"","body":"可配置爬虫\n可配置爬虫是版本v0.2.1开发的功能。目的是将具有相似网站结构的爬虫项目可配置化,将开发爬虫的过程流程化,大大提高爬虫开发效率。\nCrawlab的可配置爬虫是基于Scrapy的,因此天生支持并发。而且,可配置爬虫完全支持自定义爬虫的一般功能,因此也支持任务调度、任务监控、日志监控、数据分析。\n添加爬虫\n在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮。\n\n点击可配置爬虫。\n\n输入完基本信息,点击添加。\n\n配置爬虫\n添加完成后,可以看到刚刚添加的可配置爬虫出现了在最下方,点击查看进入到爬虫详情。\n\n点击配置标签进入到配置页面。接下来,我们需要对爬虫规则进行配置。\n\n这里已经有一些配置好的初始输入项。我们简单介绍一下各自的含义。\n抓取类别\n这也是爬虫抓取采用的策略,也就是爬虫遍历网页是如何进行的。作为第一个版本,我们有仅列表、仅详情页、列表+详情页。\n\n仅列表页。这也是最简单的形式,爬虫遍历列表上的列表项,将数据抓取下来。\n仅详情页。爬虫只抓取详情页。\n列表+详情页。爬虫先遍历列表页,将列表项中的详情页地址提取出来并跟进抓取详情页。\n\n这里我们选择列表+详情页。\n列表项选择器 & 分页选择器\n列表项的匹和分页按钮的匹配查询,由CSS或XPath来进行匹配。\n开始URL\n爬虫最开始遍历的网址。\n遵守Robots协议\n这个默认是开启的。如果开启,爬虫将先抓取网站的robots.txt并判断页面是否可抓;否则,不会对此进行验证。用户可以选择将其关闭。请注意,任何无视Robots协议的行为都有法律风险。\n列表页字段 & 详情页字段\n这些都是再列表页或详情页中需要提取的字段。字段由CSS选择器或者XPath来匹配提取。可以选择文本或者属性。\n在检查完目标网页的元素CSS选择器之后,我们输入列表项选择器、开始URL、列表页/详情页等信息。注意勾选url为详情页URL。\n\n点击保存、预览,查看预览内容。\n\n"},"Usage/Spider/Deploy.html":{"url":"Usage/Spider/Deploy.html","title":"部署爬虫","keywords":"","body":"部署爬虫\n这里的爬虫部署是指自定义爬虫的部署,因为可配置爬虫已经内嵌到Crawlab中了,所有节点都可以使用,不需要额外部署。简单来说,就是将主机上的爬虫源代码通过HTTP的方式打包传输至worker节点上,因此节点就可以运行传输过来的爬虫了。\n部署爬虫很简单,有三种方式:\n\n在爬虫列表中点击部署所有爬虫,将所有爬虫部署到所有在线节点中;\n在爬虫列表中点击操作列的部署按钮,将指定爬虫部署到所有在线节点中;\n在爬虫详情的概览标签中,点击部署按钮,将指定爬虫部署到所有在线节点中。\n\n部署好之后,我们就可以运行爬虫了。\n"},"Usage/Spider/Run.html":{"url":"Usage/Spider/Run.html","title":"运行爬虫","keywords":"","body":"运行爬虫\n我们有两种运行爬虫的方式:\n\n手动触发\n定时任务触发\n\n手动触发\n\n在爬虫列表中操作列点击运行按钮,或者\n在爬虫详情中概览标签下点击运行按钮,或者\n对于自定义爬虫,可以在配置标签下点击运行按钮\n\n然后,Crawlab会提示任务已经派发到队列中去了,然后你可以在爬虫详情左侧看到新创建的任务。点击创建时间可以导航至任务详情。\n定时任务触发\n定时任务触发是比较常用的功能,对于增量抓取或对实时性有要求的任务很重要。这在定时任务中会详细介绍。\n"},"Usage/Spider/Analytics.html":{"url":"Usage/Spider/Analytics.html","title":"统计数据","keywords":"","body":"统计数据\n在运行了一段时间之后,爬虫会积累一些统计数据,例如运行成功率、任务数、运行时长等指标。Crawlab将这些指标汇总并呈现给开发者。\n要查看统计数据的话,只需要在爬虫详情中,点击分析标签,就可以看到爬虫的统计数据了。\n\n"},"Usage/Task/":{"url":"Usage/Task/","title":"任务","keywords":"","body":"任务\n任务其实就是指某一次抓取任务或采集任务。任务与爬虫关联,其执行的也是爬虫指定的执行命令或采集规则。抓取或采集的结果与任务关联,因此可以查看到每一次任务的结果集。Crawlab的任务是整个采集流程的核心,抓取的过程都是跟任务关联起来的,因此任务对于Crawlab来说非常重要。任务被app触发,worker通过任务队列接收任务,然后在其所在节点上执行任务。\n本小节将介绍以下内容:\n\n查看任务\n操作任务\n下载结果\n\n"},"Usage/Task/View.html":{"url":"Usage/Task/View.html","title":"查看任务","keywords":"","body":"查看任务\n任务列表\n点击侧边栏的任务导航至任务列表。可以看到最近的10个生成的任务。可以根据节点、爬虫来过滤任务。\n\n点击操作列的查看按钮,进入到该任务的任务详情。\n任务日志\n点击日志标签,可以查看任务日志。\n\n任务结果\n点击结果标签,可以查看任务结果。\n\n"},"Usage/Task/Action.html":{"url":"Usage/Task/Action.html","title":"操作任务","keywords":"","body":"操作任务\n停止任务\n当任务运行起来之后,我们因为某个原因可能需要终止任务,这时我们需要在Crawlab中停止该任务。\n导航至需要停止的任务的任务详情,点击停止按钮来终止任务。\n删除任务\n在任务列表中,点击操作列中的删除按钮,确认删除该任务。\n"},"Usage/Task/DownloadResults.html":{"url":"Usage/Task/DownloadResults.html","title":"下载结果","keywords":"","body":"下载结果\n结果储存在数据库中之后,我们有时候需要将其导出,这时可以在界面中进行导出操作。\n导航至任务详情,点击结果标签,点击下载CSV按钮,等待一会儿,结果就会以CSV的形式下载到本地。\n"},"Usage/Schedule/":{"url":"Usage/Schedule/","title":"定时任务","keywords":"","body":"定时任务\n定时任务是指定某个时刻,重复性地执行的任务,英文叫做Periodical Tasks,在Linux中也被称为Crontab。定时任务可以让任务可以被执行多次,而用户则不用手动的操作来执行任务。在生产环境中,这非常常见。定时任务对于对增量抓取或对数据实时性有要求的用户来说非常有用。\n在Crawlab中,定时任务是通过apscheduler来实现的。创建一个定时任务之后,会在名为mongo的jobstore中创建一个periodical job,apscheduler调度引擎将会不断的去数据库中匹配任务的执行时间,如果执行时间满足要求,则会在后台触发一次任务运行。\n定时任务列表会进行更新。每一次爬虫更新、删除、创建,以及定时任务的更新、删除、创建,都会触发定时任务列表的更新。\n创建定时任务\n导航至定时任务页面,可以看到定时任务的列表。\n点击添加定时任务,弹出创建定时任务的弹框。填写相应的内容,点击提交按钮创建定时任务。\n\n这里的Cron跟Linux中的crontab是一致的。如果对crontab不了解,可以参考这篇文章。\n修改定时任务\n导航至定时任务页面,点击操作列的修改按钮,弹出修改定时任务的弹框。填写相应的内容,点击提交按钮修改定时任务。\n删除定时任务\n导航至定时任务页面,点击操作列的删除按钮,确认删除该任务。\n"},"Usage/Site/":{"url":"Usage/Site/","title":"网站","keywords":"","body":"网站\n网站信息是帮助用户查看站长之家收录网站的信息的,包含Robots协议、首页响应等信息。\n\n"},"Architecture/":{"url":"Architecture/","title":"架构","keywords":"","body":"架构\nCrawlab的架构跟Celery非常相似,但是加入了包括前端、爬虫、Flower在内的额外模块,以支持爬虫管理的功能。架构图如下。\n\n节点 Node\n节点其实就是Celery中的worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。\n后台应用 Backend App\n这是一个Flask应用,提供了必要的API来支持常规操作,例如CRUD、爬虫部署以及任务运行。每一个节点需要启动Flask应用来支持爬虫部署。运行python app.py来启动应用。\n爬虫 Spider\n爬虫源代码或配置规则储存在App上,需要被部署到各个worker节点中。\n任务 Task\n任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。\n中间者 Broker\n中间者跟Celery中定义的一样,作为运行异步任务的队列。\n前端 Frontend\n前端其实就是一个基于Vue-Element-Admin的单页应用。其中重用了很多Element-UI的控件来支持相应的展示。\nFlower\n一个Celery的插件,用于监控Celery节点。\n"},"Examples/":{"url":"Examples/","title":"样例","keywords":"","body":"样例\n\n与Scrapy集成\n\n"},"Examples/ScrapyIntegration.html":{"url":"Examples/ScrapyIntegration.html","title":"与Scrapy集成","keywords":"","body":"与Scrapy集成\n以下是Crawlab跟Scrapy集成的例子,利用了Crawlab传过来的task_id和collection_name。\nimport os\nfrom pymongo import MongoClient\n\nMONGO_HOST = '192.168.99.100'\nMONGO_PORT = 27017\nMONGO_DB = 'crawlab_test'\n\n# scrapy example in the pipeline\nclass JuejinPipeline(object):\n mongo = MongoClient(host=MONGO_HOST, port=MONGO_PORT)\n db = mongo[MONGO_DB]\n col_name = os.environ.get('CRAWLAB_COLLECTION')\n if not col_name:\n col_name = 'test'\n col = db[col_name]\n\n def process_item(self, item, spider):\n item['task_id'] = os.environ.get('CRAWLAB_TASK_ID')\n self.col.save(item)\n return item\n\n"}}} \ No newline at end of file diff --git a/gitbook/Architecture/App.md b/gitbook/Architecture/App.md deleted file mode 100644 index 5d5681fd..00000000 --- a/gitbook/Architecture/App.md +++ /dev/null @@ -1,2 +0,0 @@ -# App - diff --git a/gitbook/Architecture/Celery.md b/gitbook/Architecture/Celery.md deleted file mode 100644 index 96dcec50..00000000 --- a/gitbook/Architecture/Celery.md +++ /dev/null @@ -1,2 +0,0 @@ -# Celery - diff --git a/gitbook/Architecture/README.md b/gitbook/Architecture/README.md index 21444c29..b5c058f2 100644 --- a/gitbook/Architecture/README.md +++ b/gitbook/Architecture/README.md @@ -1,2 +1,33 @@ -# 架构 +## 架构 +Crawlab的架构跟Celery非常相似,但是加入了包括前端、爬虫、Flower在内的额外模块,以支持爬虫管理的功能。架构图如下。 + + + +### 节点 Node + +节点其实就是Celery中的`worker`。一个节点运行时会连接到一个任务队列(例如`Redis`)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。 + +### 后台应用 Backend App + +这是一个Flask应用,提供了必要的API来支持常规操作,例如CRUD、爬虫部署以及任务运行。每一个节点需要启动Flask应用来支持爬虫部署。运行`python app.py`来启动应用。 + +### 爬虫 Spider + +爬虫源代码或配置规则储存在`App`上,需要被部署到各个`worker`节点中。 + +### 任务 Task + +任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。 + +### 中间者 Broker + +中间者跟Celery中定义的一样,作为运行异步任务的队列。 + +### 前端 Frontend + +前端其实就是一个基于[Vue-Element-Admin](https://github.com/PanJiaChen/vue-element-admin)的单页应用。其中重用了很多Element-UI的控件来支持相应的展示。 + +### Flower + +一个Celery的插件,用于监控Celery节点。 diff --git a/gitbook/Concept/Deploy.md b/gitbook/Concept/Deploy.md deleted file mode 100644 index 12f55ebf..00000000 --- a/gitbook/Concept/Deploy.md +++ /dev/null @@ -1,6 +0,0 @@ -# 部署 - -所有爬虫在运行前需要被部署当相应当节点中。 - -部署时,爬虫会被打包到相应的目录中,方便环境隔离,开发环境的爬虫和生产环境的爬虫需要打包部署来实现隔离。 - diff --git a/gitbook/Concept/Node.md b/gitbook/Concept/Node.md deleted file mode 100644 index 3132f93f..00000000 --- a/gitbook/Concept/Node.md +++ /dev/null @@ -1,3 +0,0 @@ -# 节点 - -节点其实就是Celery中的Worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。 diff --git a/gitbook/Concept/README.md b/gitbook/Concept/README.md deleted file mode 100644 index a36e857f..00000000 --- a/gitbook/Concept/README.md +++ /dev/null @@ -1,2 +0,0 @@ -# 概念 - diff --git a/gitbook/Concept/Spider.md b/gitbook/Concept/Spider.md deleted file mode 100644 index dd7bebc1..00000000 --- a/gitbook/Concept/Spider.md +++ /dev/null @@ -1,15 +0,0 @@ -# 爬虫 - -## 自动发现 - -在`config.py`文件中,修改变量`PROJECT_SOURCE_FILE_FOLDER`作为爬虫项目所在的目录。Crawlab后台程序会自动发现这些爬虫项目并储存到数据库中。是不是很方便? - -## 部署爬虫 - -所有爬虫需要在抓取前被部署当相应当节点中。在"爬虫详情"页面点击"Deploy"按钮,爬虫将被部署到所有有效到节点中。 - -## 运行爬虫 - -部署爬虫之后,你可以在"爬虫详情"页面点击"Run"按钮来启动爬虫。一个爬虫任务将被触发,你可以在任务列表页面中看到这个任务。 - - diff --git a/gitbook/Concept/Task.md b/gitbook/Concept/Task.md deleted file mode 100644 index bd75b96f..00000000 --- a/gitbook/Concept/Task.md +++ /dev/null @@ -1,3 +0,0 @@ -# 任务 - -任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。 diff --git a/gitbook/Examples/PuppeteerIntegration.md b/gitbook/Examples/PuppeteerIntegration.md new file mode 100644 index 00000000..e69de29b diff --git a/gitbook/Examples/README.md b/gitbook/Examples/README.md index 65afe604..32cd4c75 100644 --- a/gitbook/Examples/README.md +++ b/gitbook/Examples/README.md @@ -1,2 +1,4 @@ -# Examples +## 样例 + +1. [与Scrapy集成](/Examples/ScrapyIntegration.md) diff --git a/gitbook/Examples/ScrapyIntegration.md b/gitbook/Examples/ScrapyIntegration.md new file mode 100644 index 00000000..d2deefe6 --- /dev/null +++ b/gitbook/Examples/ScrapyIntegration.md @@ -0,0 +1,26 @@ +### 与Scrapy集成 + +以下是Crawlab跟`Scrapy`集成的例子,利用了Crawlab传过来的`task_id`和`collection_name`。 + +```python +import os +from pymongo import MongoClient + +MONGO_HOST = '192.168.99.100' +MONGO_PORT = 27017 +MONGO_DB = 'crawlab_test' + +# scrapy example in the pipeline +class JuejinPipeline(object): + mongo = MongoClient(host=MONGO_HOST, port=MONGO_PORT) + db = mongo[MONGO_DB] + col_name = os.environ.get('CRAWLAB_COLLECTION') + if not col_name: + col_name = 'test' + col = db[col_name] + + def process_item(self, item, spider): + item['task_id'] = os.environ.get('CRAWLAB_TASK_ID') + self.col.save(item) + return item +``` diff --git a/gitbook/Functions/FunctionList.md b/gitbook/Functions/FunctionList.md deleted file mode 100644 index 636126fa..00000000 --- a/gitbook/Functions/FunctionList.md +++ /dev/null @@ -1,61 +0,0 @@ -# 功能列表 - -类别 | 功能名称 | 已统计 | 备注 ---- | --- | --- | --- -全局 | 打开页面 | Y | _trackPageview -全局 | 切换中英文 | Y -全局 | 允许/禁止统计 | Y -节点 | 刷新 | Y -节点 | 查看 | Y -节点 | 删除 | Y -节点详情 | 保存 | Y -节点详情 | 切换节点 | Y -爬虫 | 部署所有爬虫 | Y -爬虫 | 导入爬虫 | Y -爬虫 | 添加爬虫-可配置爬虫 | Y -爬虫 | 添加爬虫-自定义爬虫 | Y -爬虫 | 刷新 | Y -爬虫 | 查看 | Y -爬虫 | 删除 | Y -爬虫 | 部署 | Y -爬虫 | 运行 | Y -爬虫 | 搜索网站 | Y -爬虫详情 | 切换爬虫 | Y -爬虫详情 | 切换标签 | Y -爬虫详情-概览 | 保存 | Y -爬虫详情-概览 | 部署 | Y -爬虫详情-概览 | 运行 | Y -爬虫详情-环境 | 添加 | Y -爬虫详情-环境 | 删除 | Y -爬虫详情-环境 | 保存 | Y -爬虫详情-配置 | 保存 | Y -爬虫详情-配置 | 预览 | Y -爬虫详情-配置 | 提取字段 | Y -爬虫详情-配置 | 运行 | Y -爬虫详情-配置 | 添加字段 | Y -爬虫详情-配置 | 更改字段 | Y -爬虫详情-配置 | 删除字段 | Y -爬虫详情-配置 | 设置详情页URL | Y -任务 | 选择节点 | Y -任务 | 选择爬虫 | Y -任务 | 点击爬虫详情 | Y -任务 | 点击节点详情 | Y -任务 | 搜索 | Y -任务 | 查看 | Y -任务 | 删除 | Y -任务详情 | 切换标签 | Y -任务详情-概览 | 点击爬虫详情 | Y -任务详情-概览 | 点击节点详情 | Y -任务详情-结果 | 下载CSV | Y -定时任务 | 添加 | Y -定时任务 | 修改 | Y -定时任务 | 删除 | Y -定时任务 | 提交 | Y -部署 | 刷新 | Y -网站 | 搜索 | Y -网站 | 选择主类别 | Y -网站 | 选择类别 | Y -网站 | 点击域名 | Y -网站 | 点击爬虫数 | Y -网站 | 点击Robots协议 | N - diff --git a/gitbook/README.md b/gitbook/README.md index 6112b7cc..652ea003 100644 --- a/gitbook/README.md +++ b/gitbook/README.md @@ -7,7 +7,7 @@ Crawlab是基于Celery的分布式爬虫管理平台,可以集成任何语言 项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用Crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将Crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。 -Crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。Crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。 +Crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂`scrapy`和`selenium`的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。Crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。 本使用手册会帮助您解决在安装使用Crawlab遇到的任何问题。 diff --git a/gitbook/SUMMARY.md b/gitbook/SUMMARY.md index ffecadff..e629f80f 100644 --- a/gitbook/SUMMARY.md +++ b/gitbook/SUMMARY.md @@ -18,14 +18,12 @@ * [统计数据](Usage/Spider/Analytics.md) * [任务](Usage/Task/README.md) * [查看任务](Usage/Task/View.md) - * [删除任务](Usage/Task/Delete.md) + * [操作任务](Usage/Task/Action.md) * [下载结果](Usage/Task/DownloadResults.md) * [定时任务](Usage/Schedule/README.md) * [网站](Usage/Site/README.md) * [架构](Architecture/README.md) - * [Celery](Architecture/Celery.md) - * [App](Architecture/App.md) * [样例](Examples/README.md) - * [与Scrapy集成](Examples/README.md) - * [与Puppeteer集成](Examples/README.md) + * [与Scrapy集成](Examples/ScrapyIntegration.md) + #* [与Puppeteer集成](Examples/PuppeteerIntegration.md) diff --git a/gitbook/Usage/Schedule/README.md b/gitbook/Usage/Schedule/README.md index e69de29b..b2d89a0c 100644 --- a/gitbook/Usage/Schedule/README.md +++ b/gitbook/Usage/Schedule/README.md @@ -0,0 +1,25 @@ +## 定时任务 + +定时任务是指定某个时刻,重复性地执行的任务,英文叫做`Periodical Tasks`,在`Linux`中也被称为`Crontab`。定时任务可以让任务可以被执行多次,而用户则不用手动的操作来执行任务。在生产环境中,这非常常见。定时任务对于对增量抓取或对数据实时性有要求的用户来说非常有用。 + +在Crawlab中,定时任务是通过`apscheduler`来实现的。创建一个定时任务之后,会在名为`mongo`的`jobstore`中创建一个`periodical job`,`apscheduler`调度引擎将会不断的去数据库中匹配任务的执行时间,如果执行时间满足要求,则会在后台触发一次任务运行。 + +定时任务列表会进行更新。每一次爬虫更新、删除、创建,以及定时任务的更新、删除、创建,都会触发定时任务列表的更新。 + +### 创建定时任务 + +导航至`定时任务`页面,可以看到定时任务的列表。 + +点击`添加定时任务`,弹出创建定时任务的弹框。填写相应的内容,点击`提交`按钮创建定时任务。 + + + +这里的`Cron`跟`Linux`中的`crontab`是一致的。如果对`crontab`不了解,可以参考[这篇文章](https://www.cnblogs.com/longjshz/p/5779215.html)。 + +### 修改定时任务 + +导航至`定时任务`页面,点击`操作`列的`修改`按钮,弹出修改定时任务的弹框。填写相应的内容,点击`提交`按钮修改定时任务。 + +### 删除定时任务 + +导航至`定时任务`页面,点击`操作`列的`删除`按钮,确认删除该任务。 diff --git a/gitbook/Usage/Site/README.md b/gitbook/Usage/Site/README.md index e69de29b..bbf3029b 100644 --- a/gitbook/Usage/Site/README.md +++ b/gitbook/Usage/Site/README.md @@ -0,0 +1,5 @@ +## 网站 + +网站信息是帮助用户查看[站长之家](http://top.chinaz.com/hangye/)收录网站的信息的,包含`Robots协议`、`首页响应`等信息。 + + \ No newline at end of file diff --git a/gitbook/Usage/Task/Action.md b/gitbook/Usage/Task/Action.md new file mode 100644 index 00000000..f8742266 --- /dev/null +++ b/gitbook/Usage/Task/Action.md @@ -0,0 +1,11 @@ +## 操作任务 + +### 停止任务 + +当任务运行起来之后,我们因为某个原因可能需要终止任务,这时我们需要在Crawlab中停止该任务。 + +导航至需要停止的任务的`任务详情`,点击`停止`按钮来终止任务。 + +### 删除任务 + +在`任务列表`中,点击`操作`列中的`删除`按钮,确认删除该任务。 \ No newline at end of file diff --git a/gitbook/Usage/Task/DownloadResults.md b/gitbook/Usage/Task/DownloadResults.md new file mode 100644 index 00000000..c9ed33f2 --- /dev/null +++ b/gitbook/Usage/Task/DownloadResults.md @@ -0,0 +1,5 @@ +## 下载结果 + +结果储存在数据库中之后,我们有时候需要将其导出,这时可以在界面中进行导出操作。 + +导航至`任务详情`,点击`结果`标签,点击`下载CSV`按钮,等待一会儿,结果就会以`CSV`的形式下载到本地。 diff --git a/gitbook/Usage/Task/README.md b/gitbook/Usage/Task/README.md index e69de29b..4017f61b 100644 --- a/gitbook/Usage/Task/README.md +++ b/gitbook/Usage/Task/README.md @@ -0,0 +1,8 @@ +## 任务 + +任务其实就是指某一次抓取任务或采集任务。任务与爬虫关联,其执行的也是爬虫指定的执行命令或采集规则。抓取或采集的结果与任务关联,因此可以查看到每一次任务的结果集。Crawlab的任务是整个采集流程的核心,抓取的过程都是跟任务关联起来的,因此任务对于Crawlab来说非常重要。任务被`app`触发,`worker`通过任务队列接收任务,然后在其所在节点上执行任务。 + +本小节将介绍以下内容: +1. [查看任务](/Usage/Task/View.md) +2. [操作任务](/Usage/Task/Delete.md) +3. [下载结果](/Usage/Task/DownloadResults.md) diff --git a/gitbook/Usage/Task/View.md b/gitbook/Usage/Task/View.md new file mode 100644 index 00000000..5ee0707b --- /dev/null +++ b/gitbook/Usage/Task/View.md @@ -0,0 +1,21 @@ +## 查看任务 + +### 任务列表 + +点击`侧边栏`的`任务`导航至`任务列表`。可以看到最近的10个生成的任务。可以根据`节点`、`爬虫`来过滤任务。 + + + +点击`操作`列的`查看`按钮,进入到该任务的`任务详情`。 + +### 任务日志 + +点击`日志`标签,可以查看任务日志。 + + + +### 任务结果 + +点击`结果`标签,可以查看任务结果。 + + diff --git a/gitbook/_book/Architecture/index.html b/gitbook/_book/Architecture/index.html index 10220620..21e43e32 100644 --- a/gitbook/_book/Architecture/index.html +++ b/gitbook/_book/Architecture/index.html @@ -57,7 +57,7 @@ - + @@ -336,9 +336,9 @@Crawlab的架构跟Celery非常相似,但是加入了包括前端、爬虫、Flower在内的额外模块,以支持爬虫管理的功能。架构图如下。
+
节点其实就是Celery中的worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。
这是一个Flask应用,提供了必要的API来支持常规操作,例如CRUD、爬虫部署以及任务运行。每一个节点需要启动Flask应用来支持爬虫部署。运行python app.py来启动应用。
爬虫源代码或配置规则储存在App上,需要被部署到各个worker节点中。
任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。
+中间者跟Celery中定义的一样,作为运行异步任务的队列。
+前端其实就是一个基于Vue-Element-Admin的单页应用。其中重用了很多Element-UI的控件来支持相应的展示。
+一个Celery的插件,用于监控Celery节点。
以下是Crawlab跟Scrapy集成的例子,利用了Crawlab传过来的task_id和collection_name。
import os
+from pymongo import MongoClient
+
+MONGO_HOST = '192.168.99.100'
+MONGO_PORT = 27017
+MONGO_DB = 'crawlab_test'
+
+# scrapy example in the pipeline
+class JuejinPipeline(object):
+ mongo = MongoClient(host=MONGO_HOST, port=MONGO_PORT)
+ db = mongo[MONGO_DB]
+ col_name = os.environ.get('CRAWLAB_COLLECTION')
+ if not col_name:
+ col_name = 'test'
+ col = db[col_name]
+
+ def process_item(self, item, spider):
+ item['task_id'] = os.environ.get('CRAWLAB_TASK_ID')
+ self.col.save(item)
+ return item
+
+
+
+ 定时任务是指定某个时刻,重复性地执行的任务,英文叫做Periodical Tasks,在Linux中也被称为Crontab。定时任务可以让任务可以被执行多次,而用户则不用手动的操作来执行任务。在生产环境中,这非常常见。定时任务对于对增量抓取或对数据实时性有要求的用户来说非常有用。
在Crawlab中,定时任务是通过apscheduler来实现的。创建一个定时任务之后,会在名为mongo的jobstore中创建一个periodical job,apscheduler调度引擎将会不断的去数据库中匹配任务的执行时间,如果执行时间满足要求,则会在后台触发一次任务运行。
定时任务列表会进行更新。每一次爬虫更新、删除、创建,以及定时任务的更新、删除、创建,都会触发定时任务列表的更新。
+导航至定时任务页面,可以看到定时任务的列表。
点击添加定时任务,弹出创建定时任务的弹框。填写相应的内容,点击提交按钮创建定时任务。

这里的Cron跟Linux中的crontab是一致的。如果对crontab不了解,可以参考这篇文章。
导航至定时任务页面,点击操作列的修改按钮,弹出修改定时任务的弹框。填写相应的内容,点击提交按钮修改定时任务。
导航至定时任务页面,点击操作列的删除按钮,确认删除该任务。
网站信息是帮助用户查看站长之家收录网站的信息的,包含Robots协议、首页响应等信息。

任务其实就是指某一次抓取任务或采集任务。任务与爬虫关联,其执行的也是爬虫指定的执行命令或采集规则。抓取或采集的结果与任务关联,因此可以查看到每一次任务的结果集。Crawlab的任务是整个采集流程的核心,抓取的过程都是跟任务关联起来的,因此任务对于Crawlab来说非常重要。任务被app触发,worker通过任务队列接收任务,然后在其所在节点上执行任务。
本小节将介绍以下内容:
+ +Crawlab是基于Celery的分布式爬虫管理平台,可以集成任何语言和任何框架。
项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用Crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将Crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。
-Crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。Crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。
+Crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。Crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。
本使用手册会帮助您解决在安装使用Crawlab遇到的任何问题。
首先,我们来看如何安装Crawlab吧,请查看安装。
@@ -591,7 +546,7 @@ diff --git a/gitbook/_book/search_index.json b/gitbook/_book/search_index.json index 14b6b582..d98d5152 100644 --- a/gitbook/_book/search_index.json +++ b/gitbook/_book/search_index.json @@ -1 +1 @@ -{"index":{"version":"0.5.12","fields":[{"name":"title","boost":10},{"name":"keywords","boost":15},{"name":"body","boost":1}],"ref":"url","documentStore":{"store":{"./":["crawlab","crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。","crawlab是基于celery的分布式爬虫管理平台,可以集成任何语言和任何框架。","crawlab简介","demo","基于celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.","本使用手册会帮助您解决在安装使用crawlab遇到的任何问题。","查看演示","项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。","首先,我们来看如何安装crawlab吧,请查看安装。"],"Installation/":["docker","安装crawlab","本小节将介绍三种安装docker的方式:","直接部署","预览模式"],"Installation/Docker.html":["\"27017:27017\"","\"6379:6379\"","\"8000:8000\"","\"8001:8000\"","\"8002:8000\"","\"8080:8080\"","\"registri","#","'3.3'","/bin/sh","/home/yeqing/.env.production.master:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production:/opt/crawlab/frontend/.env.product","/home/yeqing/config.master.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.pi","/opt/crawlab/docker_init.sh","27017:27017","30秒的时间来build前端静态文件,之后就可以打开crawlab界面地址地址看到界面了。界面地址默认为http://localhost:8080。","8000:8000","8080:8080","[\"https://registry.dock","\\","alway","app","cn.com\"]","compos","compose.yml后,只需要运行以下命令就可以启动crawlab。","compose.yml定义如下。","compose.yml更改为如下内容。","compose.yml的yaml文件来定义需要启动的容器,可以是单个,也可以(通常)是多个的。crawlab的dock","compose也很简单,大家去网上百度一下就可以了。","compose和定义好dock","compose是一个集群管理方式,可以利用名为dock","compose的方式很适合多节点部署,在原有的master基础上增加几个worker节点,达到多节点部署的目的。将dock","compose的方式来部署。dock","container_name:","crawlab","d","depends_on:","docker","docker安装部署","entrypoint:","image:","master","master:","mirrors\":","mongo","mongo:","mongo:latest","mongo一行命令。如何安装docker跟操作系统有关,这里就不展开讲了,需要的同学自行百度一下相关教程。","name","nginx","p","ports:","pull","redi","redis:","redis:latest","restart:","rm","run","services:","tikazyq/crawlab","tikazyq/crawlab:latest","up","v","version:","volumns:","worker","worker1:","worker2:","{","}","下载镜像","其中,我们映射了8080端口(nginx前端静态文件)以及8000端口(后端api)到宿主机。另外还将前端配置文件/home/yeqing/.env.production和后端配置文件/home/yeqing/config.py映射到了容器相应的目录下。传入参数master是代表该启动方式为主机启动模式,也就是所有服务(前端、api、flower、worker)都会启动。另外一个模式是worker模式,只会启动必要的api和worker服务,这个对于分布式部署比较有用。等待大约20","前端配置文件","同样,在浏览器中输入http://localhost:8080就可以看到界面。","后端配置文件","多节点模式","安装docker","安装完docker","对docker不了解的开发者,可以参考一下这篇文章(9102","年了,学点","当然,也可以用docker","我们已经在dockerhub上构建了crawlab的镜像,开发者只需要将其pull下来使用。在pul","执行以下命令将crawlab的镜像下载下来。镜像大小大概在几百兆,因此下载需要几分钟时间。","拷贝一份后端配置文件./crawlab/config/config.py以及前端配置文件./frontend/.env.production到某一个地方。例如我的例子,分别为/home/yeqing/config.py和/home/yeqing/.env.production。","更改后端配置文件config.py,将mongodb、redis的指向ip更改为自己数据的值。注意,容器中对应的宿主机的ip地址不是localhost,而是172.17.0.1(当然也可以用network来做,只是稍微麻烦一些)。更改前端配置文件.env.production,将api地址vue_app_base_url更改为宿主机所在的ip地址,例如http://192.168.0.8:8000,这将是前端调用api会用到的url。","更改好配置文件之后,接下来就是运行容器了。执行以下命令来启动容器。","更改配置文件","知识)做进一步了解。简单来说,docker可以利用已存在的镜像帮助构建一些常用的服务和应用,例如nginx、mongodb、redis等等。用docker运行一个mongodb服务仅需dock","运行docker容器","这应该是部署应用的最方便也是最节省时间的方式了。在最近的一次版本更新v0.2.3中,我们发布了docker功能,让大家可以利用docker来轻松部署crawlab。下面将一步一步介绍如何使用docker来部署crawlab。","这样的话,pull镜像的速度会比不改变镜像源的速度快很多。","这里先定义了master节点,也就是crawlab的主节点。master依赖于mongo和redis容器,因此在启动之前会同时启动mongo和redis容器。这样就不需要单独配置mongo和redis服务了,大大节省了环境配置的时间。","这里启动了多增加了两个worker节点,以worker模式启动。这样,多节点部署,也就是分布式部署就完成了。","镜像之前,我们需要配置一下镜像源。因为我们在墙内,使用原有的镜像源速度非常感人,因此将使用dockerhub在国内的加速器。创建/etc/docker/daemon.json文件,在其中输入如下内容。"],"Installation/Direct.html":["#","../crawlab","../frontend","/home/yeqing/jenkins_home/workspace/crawlab_develop/frontend/dist;","16.04是以下命令。","8080;","[app]","api服务","app.pi","apt","build:prod","cd","clone","dev.crawlab.com;","flower","flower.pi","frontend","g","git","https://github.com/tikazyq/crawlab","index","index.html;","instal","listen","log","nginx","npm","pip","pm2","r","reload","requir","root","run","server","server_nam","start","sudo","worker","worker.pi","yarn","{","}","其中,root是静态文件的根目录,这里是npm打包好后的静态文件。","分别配置前端配置文件./frontend/.env.production和后端配置文件./crawlab/config/config.py。分别需要对部署后api地址以及数据库地址进行配置。","启动服务","安装","安装nginx,在ubuntu","安装前端所需库。","安装后端所需库。","拉取代码","构建","构建完成后,会在./frontend目录下创建一个dist文件夹,里面是打包好后的静态文件。","添加/etc/nginx/conf.d/crawlab.conf文件,输入以下内容。","然后在浏览器中输入http://localhost:8080就可以看到界面了。","现在,只需要启动nginx服务就完成了启动前端服务。","直接部署","直接部署是之前没有docker时的部署方式,相对于docker部署来说有些繁琐。但了解如何直接部署可以帮助更深入地理解docker是如何构建crawlab镜像的。这里简单介绍一下。","这样,pm2会启动3个守护进程来管理这3个服务。我们如果想看后端服务的日志的话,可以执行以下命令。","这里是指启动后端服务。我们用pm2来管理进程。执行以下命令。","这里的构建是指前端构建,需要执行以下命令。","配置","首先是将github上的代码拉取到本地。"],"Installation/Preview.html":["manage.pi","python","run","serv","serve来进行的,因此是开发者模式。注意:强烈不建议在生产环境中用预览模式。预览模式只是让开发者快速体验crawlab以及调试代码问题的一种方式,而不是用作生产环境部署的。","该模式同样会启动3个后端服务和1个前端服务。前端服务是通过npm","预览模式","预览模式是一种让用户比较快的上手的一种部署模式。跟直接部署类似,但不用经过构建、nginx和启动服务的步骤。在启动时只需要执行以下命令就可以了。相较于直接部署来说方便一些。"],"Usage/":["任务","使用crawlab","定时任务","本小节将介绍如何使用crawlab,包括如下内容:","爬虫","节点"],"Usage/Node/":["修改节点信息","查看节点","节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口(默认为localhost:8000)。"],"Usage/Node/View.html":["worker,他们通过连接到配置好的broker(通常是redis)来进行与主机的通信。","查看节点列表","点击侧边栏的节点导航至节点列表,可以看到已上线的节点。这里的节点其实就是已经运行起来的celeri"],"Usage/Node/Edit.html":["修改节点信息","后面我们需要让爬虫运行在各个节点上,需要让主机与节点进行通信,因此需要知道节点的ip地址和端口。我们需要手动配置一下节点的ip和端口。在节点列表中点击操作列里的蓝色查看按钮进入到节点详情。节点详情样子如下。","在右侧分别输入该节点对应的节点ip和节点端口,然后点击保存按钮,保存该节点信息。","这样,我们就完成了节点的配置工作。"],"Usage/Spider/":["创建爬虫","可配置爬虫","爬虫","爬虫就是我们通常说的网络爬虫了,本小节将介绍如下内容:","统计数据","运行爬虫","部署爬虫"],"Usage/Spider/Create.html":["crawlab允许用户创建两种爬虫:","创建爬虫","前者可以通过web界面和创建项目目录的方式来添加,后者由于没有源代码,只能通过web界面来添加。","可配置爬虫","自定义爬虫"],"Usage/Spider/CustomizedSpider.html":["crawlab会自动发现project_source_file_folder目录下的所有爬虫目录,并将这些目录生成自定义爬虫并集成到crawlab中。因此,将爬虫项目目录拷贝到project_source_file_folder目录下,就可以添加一个爬虫了。","在定义爬虫中,我们需要配置一下执行命令(运行爬虫时后台执行的shell命令)和结果集(通过crawlab_collection传递给爬虫程序,爬虫程序存储结果的地方),然后点击保存按钮保存爬虫信息。","在通过web界面上传之前,需要将爬虫项目文件打包成zip格式。","接下来,我们就可以部署、运行自定义爬虫了。","然后,在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮,选择自定义爬虫,点击上传按钮,选择刚刚打包好的zip文件。上传成功后,爬虫列表中会出现新添加的自定义爬虫。这样就算添加好了。","自定义爬虫","自定义爬虫是指用户可以添加的任何语言任何框架的爬虫,高度自定义化。当用户添加好自定义爬虫之后,crawlab就可以将其集成到爬虫管理的系统中来。","自定义爬虫的添加有两种方式:","这个方式稍微有些繁琐,但是对于无法轻松获取服务器的读写权限时是非常有用的,适合在生产环境上使用。","这种方式非常方便,但是需要获得主机服务器的读写权限,因而比较适合在开发环境上采用。","通过web界面上传","通过web界面上传爬虫","通过创建项目目录","通过添加项目目录","配置爬虫"],"Usage/Spider/ConfigurableSpider.html":["&","crawlab的可配置爬虫是基于scrapy的,因此天生支持并发。而且,可配置爬虫完全支持自定义爬虫的一般功能,因此也支持任务调度、任务监控、日志监控、数据分析。","仅列表页。这也是最简单的形式,爬虫遍历列表上的列表项,将数据抓取下来。","仅详情页。爬虫只抓取详情页。","分页选择器","列表+详情页。爬虫先遍历列表页,将列表项中的详情页地址提取出来并跟进抓取详情页。","列表页字段","列表项的匹和分页按钮的匹配查询,由css或xpath来进行匹配。","列表项选择器","可配置爬虫","可配置爬虫是版本v0.2.1开发的功能。目的是将具有相似网站结构的爬虫项目可配置化,将开发爬虫的过程流程化,大大提高爬虫开发效率。","在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮。","在检查完目标网页的元素css选择器之后,我们输入列表项选择器、开始url、列表页/详情页等信息。注意勾选url为详情页url。","开始url","抓取类别","添加完成后,可以看到刚刚添加的可配置爬虫出现了在最下方,点击查看进入到爬虫详情。","添加爬虫","点击保存、预览,查看预览内容。","点击可配置爬虫。","点击配置标签进入到配置页面。接下来,我们需要对爬虫规则进行配置。","爬虫最开始遍历的网址。","详情页字段","输入完基本信息,点击添加。","这个默认是开启的。如果开启,爬虫将先抓取网站的robots.txt并判断页面是否可抓;否则,不会对此进行验证。用户可以选择将其关闭。请注意,任何无视robots协议的行为都有法律风险。","这也是爬虫抓取采用的策略,也就是爬虫遍历网页是如何进行的。作为第一个版本,我们有仅列表、仅详情页、列表+详情页。","这些都是再列表页或详情页中需要提取的字段。字段由css选择器或者xpath来匹配提取。可以选择文本或者属性。","这里已经有一些配置好的初始输入项。我们简单介绍一下各自的含义。","这里我们选择列表+详情页。","遵守robots协议","配置爬虫"],"Usage/Spider/Deploy.html":["在爬虫列表中点击操作列的部署按钮,将指定爬虫部署到所有在线节点中;","在爬虫列表中点击部署所有爬虫,将所有爬虫部署到所有在线节点中;","在爬虫详情的概览标签中,点击部署按钮,将指定爬虫部署到所有在线节点中。","这里的爬虫部署是指自定义爬虫的部署,因为可配置爬虫已经内嵌到crawlab中了,所有节点都可以使用,不需要额外部署。简单来说,就是将主机上的爬虫源代码通过http的方式打包传输至worker节点上,因此节点就可以运行传输过来的爬虫了。","部署好之后,我们就可以运行爬虫了。","部署爬虫","部署爬虫很简单,有三种方式:"],"Usage/Spider/Run.html":["在爬虫列表中操作列点击运行按钮,或者","在爬虫详情中概览标签下点击运行按钮,或者","定时任务触发","定时任务触发是比较常用的功能,对于增量抓取或对实时性有要求的任务很重要。这在定时任务中会详细介绍。","对于自定义爬虫,可以在配置标签下点击运行按钮","我们有两种运行爬虫的方式:","手动触发","然后,crawlab会提示任务已经派发到队列中去了,然后你可以在爬虫详情左侧看到新创建的任务。点击创建时间可以导航至任务详情。","运行爬虫"],"Usage/Spider/Analytics.html":["在运行了一段时间之后,爬虫会积累一些统计数据,例如运行成功率、任务数、运行时长等指标。crawlab将这些指标汇总并呈现给开发者。","统计数据","要查看统计数据的话,只需要在爬虫详情中,点击分析标签,就可以看到爬虫的统计数据了。"],"Usage/Task/":["任务"],"Usage/Schedule/":["定时任务"],"Usage/Site/":["网站"],"Architecture/":["架构"],"Architecture/Celery.html":["celeri"],"Architecture/App.html":["app"],"Examples/":["exampl","样例"]},"length":23},"tokenStore":{"root":{"1":{"6":{"docs":{},".":{"0":{"4":{"docs":{},"是":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}},"docs":{}},"docs":{}}},"docs":{}},"2":{"7":{"0":{"1":{"7":{"docs":{},":":{"2":{"7":{"0":{"1":{"7":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"3":{"0":{"docs":{},"秒":{"docs":{},"的":{"docs":{},"时":{"docs":{},"间":{"docs":{},"来":{"docs":{},"b":{"docs":{},"u":{"docs":{},"i":{"docs":{},"l":{"docs":{},"d":{"docs":{},"前":{"docs":{},"端":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},",":{"docs":{},"之":{"docs":{},"后":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"打":{"docs":{},"开":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"地":{"docs":{},"址":{"docs":{},"地":{"docs":{},"址":{"docs":{},"看":{"docs":{},"到":{"docs":{},"界":{"docs":{},"面":{"docs":{},"了":{"docs":{},"。":{"docs":{},"界":{"docs":{},"面":{"docs":{},"地":{"docs":{},"址":{"docs":{},"默":{"docs":{},"认":{"docs":{},"为":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"8":{"0":{"0":{"0":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"8":{"0":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"./":{"ref":"./","tf":0.1111111111111111},"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.014634146341463415}},"主":{"docs":{},"要":{"docs":{},"解":{"docs":{},"决":{"docs":{},"的":{"docs":{},"是":{"docs":{},"大":{"docs":{},"量":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"困":{"docs":{},"难":{"docs":{},"的":{"docs":{},"问":{"docs":{},"题":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"需":{"docs":{},"要":{"docs":{},"监":{"docs":{},"控":{"docs":{},"上":{"docs":{},"百":{"docs":{},"个":{"docs":{},"网":{"docs":{},"站":{"docs":{},"的":{"docs":{},"参":{"docs":{},"杂":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"和":{"docs":{},"s":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"n":{"docs":{},"i":{"docs":{},"u":{"docs":{},"m":{"docs":{},"的":{"docs":{},"项":{"docs":{},"目":{"docs":{},"不":{"docs":{},"容":{"docs":{},"易":{"docs":{},"做":{"docs":{},"到":{"docs":{},"同":{"docs":{},"时":{"docs":{},"管":{"docs":{},"理":{"docs":{},",":{"docs":{},"而":{"docs":{},"且":{"docs":{},"命":{"docs":{},"令":{"docs":{},"行":{"docs":{},"管":{"docs":{},"理":{"docs":{},"的":{"docs":{},"成":{"docs":{},"本":{"docs":{},"非":{"docs":{},"常":{"docs":{},"高":{"docs":{},",":{"docs":{},"还":{"docs":{},"容":{"docs":{},"易":{"docs":{},"出":{"docs":{},"错":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"支":{"docs":{},"持":{"docs":{},"任":{"docs":{},"何":{"docs":{},"语":{"docs":{},"言":{"docs":{},"和":{"docs":{},"任":{"docs":{},"何":{"docs":{},"框":{"docs":{},"架":{"docs":{},",":{"docs":{},"配":{"docs":{},"合":{"docs":{},"任":{"docs":{},"务":{"docs":{},"调":{"docs":{},"度":{"docs":{},"、":{"docs":{},"任":{"docs":{},"务":{"docs":{},"监":{"docs":{},"控":{"docs":{},",":{"docs":{},"很":{"docs":{},"容":{"docs":{},"易":{"docs":{},"做":{"docs":{},"到":{"docs":{},"对":{"docs":{},"成":{"docs":{},"规":{"docs":{},"模":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"进":{"docs":{},"行":{"docs":{},"有":{"docs":{},"效":{"docs":{},"监":{"docs":{},"控":{"docs":{},"管":{"docs":{},"理":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"基":{"docs":{},"于":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"的":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"平":{"docs":{},"台":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"集":{"docs":{},"成":{"docs":{},"任":{"docs":{},"何":{"docs":{},"语":{"docs":{},"言":{"docs":{},"和":{"docs":{},"任":{"docs":{},"何":{"docs":{},"框":{"docs":{},"架":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"简":{"docs":{},"介":{"docs":{"./":{"ref":"./","tf":10}}}},"允":{"docs":{},"许":{"docs":{},"用":{"docs":{},"户":{"docs":{},"创":{"docs":{},"建":{"docs":{},"两":{"docs":{},"种":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},":":{"docs":{"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2}}}}}}}}}}}}},"会":{"docs":{},"自":{"docs":{},"动":{"docs":{},"发":{"docs":{},"现":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"_":{"docs":{},"s":{"docs":{},"o":{"docs":{},"u":{"docs":{},"r":{"docs":{},"c":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"i":{"docs":{},"l":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},"的":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"目":{"docs":{},"录":{"docs":{},",":{"docs":{},"并":{"docs":{},"将":{"docs":{},"这":{"docs":{},"些":{"docs":{},"目":{"docs":{},"录":{"docs":{},"生":{"docs":{},"成":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"并":{"docs":{},"集":{"docs":{},"成":{"docs":{},"到":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"中":{"docs":{},"。":{"docs":{},"因":{"docs":{},"此":{"docs":{},",":{"docs":{},"将":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{},"拷":{"docs":{},"贝":{"docs":{},"到":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"_":{"docs":{},"s":{"docs":{},"o":{"docs":{},"u":{"docs":{},"r":{"docs":{},"c":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"i":{"docs":{},"l":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},",":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"添":{"docs":{},"加":{"docs":{},"一":{"docs":{},"个":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"的":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"是":{"docs":{},"基":{"docs":{},"于":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"的":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"天":{"docs":{},"生":{"docs":{},"支":{"docs":{},"持":{"docs":{},"并":{"docs":{},"发":{"docs":{},"。":{"docs":{},"而":{"docs":{},"且":{"docs":{},",":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"完":{"docs":{},"全":{"docs":{},"支":{"docs":{},"持":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"一":{"docs":{},"般":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"也":{"docs":{},"支":{"docs":{},"持":{"docs":{},"任":{"docs":{},"务":{"docs":{},"调":{"docs":{},"度":{"docs":{},"、":{"docs":{},"任":{"docs":{},"务":{"docs":{},"监":{"docs":{},"控":{"docs":{},"、":{"docs":{},"日":{"docs":{},"志":{"docs":{},"监":{"docs":{},"控":{"docs":{},"、":{"docs":{},"数":{"docs":{},"据":{"docs":{},"分":{"docs":{},"析":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"n":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"m":{"docs":{},"\"":{"docs":{},"]":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}},"o":{"docs":{},"m":{"docs":{},"p":{"docs":{},"o":{"docs":{},"s":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"e":{"docs":{},".":{"docs":{},"y":{"docs":{},"m":{"docs":{},"l":{"docs":{},"后":{"docs":{},",":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"运":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"启":{"docs":{},"动":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}},"定":{"docs":{},"义":{"docs":{},"如":{"docs":{},"下":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}},"更":{"docs":{},"改":{"docs":{},"为":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"的":{"docs":{},"y":{"docs":{},"a":{"docs":{},"m":{"docs":{},"l":{"docs":{},"文":{"docs":{},"件":{"docs":{},"来":{"docs":{},"定":{"docs":{},"义":{"docs":{},"需":{"docs":{},"要":{"docs":{},"启":{"docs":{},"动":{"docs":{},"的":{"docs":{},"容":{"docs":{},"器":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"是":{"docs":{},"单":{"docs":{},"个":{"docs":{},",":{"docs":{},"也":{"docs":{},"可":{"docs":{},"以":{"docs":{},"(":{"docs":{},"通":{"docs":{},"常":{"docs":{},")":{"docs":{},"是":{"docs":{},"多":{"docs":{},"个":{"docs":{},"的":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"也":{"docs":{},"很":{"docs":{},"简":{"docs":{},"单":{"docs":{},",":{"docs":{},"大":{"docs":{},"家":{"docs":{},"去":{"docs":{},"网":{"docs":{},"上":{"docs":{},"百":{"docs":{},"度":{"docs":{},"一":{"docs":{},"下":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"了":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}},"和":{"docs":{},"定":{"docs":{},"义":{"docs":{},"好":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"是":{"docs":{},"一":{"docs":{},"个":{"docs":{},"集":{"docs":{},"群":{"docs":{},"管":{"docs":{},"理":{"docs":{},"方":{"docs":{},"式":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"利":{"docs":{},"用":{"docs":{},"名":{"docs":{},"为":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"很":{"docs":{},"适":{"docs":{},"合":{"docs":{},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"部":{"docs":{},"署":{"docs":{},",":{"docs":{},"在":{"docs":{},"原":{"docs":{},"有":{"docs":{},"的":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"基":{"docs":{},"础":{"docs":{},"上":{"docs":{},"增":{"docs":{},"加":{"docs":{},"几":{"docs":{},"个":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},",":{"docs":{},"达":{"docs":{},"到":{"docs":{},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"部":{"docs":{},"署":{"docs":{},"的":{"docs":{},"目":{"docs":{},"的":{"docs":{},"。":{"docs":{},"将":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"来":{"docs":{},"部":{"docs":{},"署":{"docs":{},"。":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}},"n":{"docs":{},"t":{"docs":{},"a":{"docs":{},"i":{"docs":{},"n":{"docs":{},"e":{"docs":{},"r":{"docs":{},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375}}},"l":{"docs":{},"o":{"docs":{},"n":{"docs":{},"e":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"i":{"docs":{"Architecture/Celery.html":{"ref":"Architecture/Celery.html","tf":11}}}}}}}},"d":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"e":{"docs":{},"m":{"docs":{},"o":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}},"p":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"s":{"docs":{},"_":{"docs":{},"o":{"docs":{},"n":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}}},"v":{"docs":{},".":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"m":{"docs":{},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25},"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":10.029268292682927}},"安":{"docs":{},"装":{"docs":{},"部":{"docs":{},"署":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}},"基":{"docs":{},"于":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"平":{"docs":{},"台":{"docs":{},",":{"docs":{},"支":{"docs":{},"持":{"docs":{},"多":{"docs":{},"种":{"docs":{},"编":{"docs":{},"程":{"docs":{},"语":{"docs":{},"言":{"docs":{},"以":{"docs":{},"及":{"docs":{},"多":{"docs":{},"种":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"框":{"docs":{},"架":{"docs":{},".":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"本":{"docs":{},"使":{"docs":{},"用":{"docs":{},"手":{"docs":{},"册":{"docs":{},"会":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"您":{"docs":{},"解":{"docs":{},"决":{"docs":{},"在":{"docs":{},"安":{"docs":{},"装":{"docs":{},"使":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"遇":{"docs":{},"到":{"docs":{},"的":{"docs":{},"任":{"docs":{},"何":{"docs":{},"问":{"docs":{},"题":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"小":{"docs":{},"节":{"docs":{},"将":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"三":{"docs":{},"种":{"docs":{},"安":{"docs":{},"装":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25}}}}}}}}}}}}}}}},"如":{"docs":{},"何":{"docs":{},"使":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},",":{"docs":{},"包":{"docs":{},"括":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},":":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2}}}}}}}}}}}}}}}}}}}}}}}}}}},"查":{"docs":{},"看":{"docs":{},"演":{"docs":{},"示":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}},"节":{"docs":{},"点":{"docs":{"Usage/Node/":{"ref":"Usage/Node/","tf":0.25}},"列":{"docs":{},"表":{"docs":{"Usage/Node/View.html":{"ref":"Usage/Node/View.html","tf":10.333333333333334}}}}}}}},"项":{"docs":{},"目":{"docs":{},"自":{"docs":{},"今":{"docs":{},"年":{"docs":{},"三":{"docs":{},"月":{"docs":{},"份":{"docs":{},"上":{"docs":{},"线":{"docs":{},"以":{"docs":{},"来":{"docs":{},"受":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"爱":{"docs":{},"好":{"docs":{},"者":{"docs":{},"们":{"docs":{},"和":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"们":{"docs":{},"的":{"docs":{},"好":{"docs":{},"评":{"docs":{},",":{"docs":{},"不":{"docs":{},"少":{"docs":{},"使":{"docs":{},"用":{"docs":{},"者":{"docs":{},"还":{"docs":{},"表":{"docs":{},"示":{"docs":{},"会":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"搭":{"docs":{},"建":{"docs":{},"公":{"docs":{},"司":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"平":{"docs":{},"台":{"docs":{},"。":{"docs":{},"经":{"docs":{},"过":{"docs":{},"近":{"3":{"docs":{},"个":{"docs":{},"月":{"docs":{},"的":{"docs":{},"迭":{"docs":{},"代":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"陆":{"docs":{},"续":{"docs":{},"上":{"docs":{},"线":{"docs":{},"了":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"、":{"docs":{},"数":{"docs":{},"据":{"docs":{},"分":{"docs":{},"析":{"docs":{},"、":{"docs":{},"网":{"docs":{},"站":{"docs":{},"信":{"docs":{},"息":{"docs":{},"、":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"、":{"docs":{},"自":{"docs":{},"动":{"docs":{},"提":{"docs":{},"取":{"docs":{},"字":{"docs":{},"段":{"docs":{},"、":{"docs":{},"下":{"docs":{},"载":{"docs":{},"结":{"docs":{},"果":{"docs":{},"、":{"docs":{},"上":{"docs":{},"传":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"等":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"将":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"打":{"docs":{},"造":{"docs":{},"得":{"docs":{},"更":{"docs":{},"加":{"docs":{},"实":{"docs":{},"用":{"docs":{},",":{"docs":{},"更":{"docs":{},"加":{"docs":{},"全":{"docs":{},"面":{"docs":{},",":{"docs":{},"能":{"docs":{},"够":{"docs":{},"真":{"docs":{},"正":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"用":{"docs":{},"户":{"docs":{},"解":{"docs":{},"决":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"困":{"docs":{},"难":{"docs":{},"的":{"docs":{},"问":{"docs":{},"题":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"首":{"docs":{},"先":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"来":{"docs":{},"看":{"docs":{},"如":{"docs":{},"何":{"docs":{},"安":{"docs":{},"装":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"吧":{"docs":{},",":{"docs":{},"请":{"docs":{},"查":{"docs":{},"看":{"docs":{},"安":{"docs":{},"装":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"将":{"docs":{},"g":{"docs":{},"i":{"docs":{},"t":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},"上":{"docs":{},"的":{"docs":{},"代":{"docs":{},"码":{"docs":{},"拉":{"docs":{},"取":{"docs":{},"到":{"docs":{},"本":{"docs":{},"地":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}},"安":{"docs":{},"装":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/":{"ref":"Installation/","tf":10}}}}}}}}},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}},"完":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},",":{"docs":{},"在":{"docs":{},"u":{"docs":{},"b":{"docs":{},"u":{"docs":{},"n":{"docs":{},"t":{"docs":{},"u":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}},"前":{"docs":{},"端":{"docs":{},"所":{"docs":{},"需":{"docs":{},"库":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}},"后":{"docs":{},"端":{"docs":{},"所":{"docs":{},"需":{"docs":{},"库":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":10.0125}},"是":{"docs":{},"之":{"docs":{},"前":{"docs":{},"没":{"docs":{},"有":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"时":{"docs":{},"的":{"docs":{},"部":{"docs":{},"署":{"docs":{},"方":{"docs":{},"式":{"docs":{},",":{"docs":{},"相":{"docs":{},"对":{"docs":{},"于":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"部":{"docs":{},"署":{"docs":{},"来":{"docs":{},"说":{"docs":{},"有":{"docs":{},"些":{"docs":{},"繁":{"docs":{},"琐":{"docs":{},"。":{"docs":{},"但":{"docs":{},"了":{"docs":{},"解":{"docs":{},"如":{"docs":{},"何":{"docs":{},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{},"可":{"docs":{},"以":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"更":{"docs":{},"深":{"docs":{},"入":{"docs":{},"地":{"docs":{},"理":{"docs":{},"解":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"是":{"docs":{},"如":{"docs":{},"何":{"docs":{},"构":{"docs":{},"建":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"的":{"docs":{},"。":{"docs":{},"这":{"docs":{},"里":{"docs":{},"简":{"docs":{},"单":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"一":{"docs":{},"下":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"预":{"docs":{},"览":{"docs":{},"模":{"docs":{},"式":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25},"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":10.125}},"是":{"docs":{},"一":{"docs":{},"种":{"docs":{},"让":{"docs":{},"用":{"docs":{},"户":{"docs":{},"比":{"docs":{},"较":{"docs":{},"快":{"docs":{},"的":{"docs":{},"上":{"docs":{},"手":{"docs":{},"的":{"docs":{},"一":{"docs":{},"种":{"docs":{},"部":{"docs":{},"署":{"docs":{},"模":{"docs":{},"式":{"docs":{},"。":{"docs":{},"跟":{"docs":{},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{},"类":{"docs":{},"似":{"docs":{},",":{"docs":{},"但":{"docs":{},"不":{"docs":{},"用":{"docs":{},"经":{"docs":{},"过":{"docs":{},"构":{"docs":{},"建":{"docs":{},"、":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"和":{"docs":{},"启":{"docs":{},"动":{"docs":{},"服":{"docs":{},"务":{"docs":{},"的":{"docs":{},"步":{"docs":{},"骤":{"docs":{},"。":{"docs":{},"在":{"docs":{},"启":{"docs":{},"动":{"docs":{},"时":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"了":{"docs":{},"。":{"docs":{},"相":{"docs":{},"较":{"docs":{},"于":{"docs":{},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{},"来":{"docs":{},"说":{"docs":{},"方":{"docs":{},"便":{"docs":{},"一":{"docs":{},"些":{"docs":{},"。":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"\"":{"2":{"7":{"0":{"1":{"7":{"docs":{},":":{"2":{"7":{"0":{"1":{"7":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"6":{"3":{"7":{"9":{"docs":{},":":{"6":{"3":{"7":{"9":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"8":{"0":{"0":{"0":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"1":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"2":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"8":{"0":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"docs":{},"r":{"docs":{},"e":{"docs":{},"g":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"r":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}},"#":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.06829268292682927},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375}}},"'":{"3":{"docs":{},".":{"3":{"docs":{},"'":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}}},"docs":{}},"/":{"docs":{},"b":{"docs":{},"i":{"docs":{},"n":{"docs":{},"/":{"docs":{},"s":{"docs":{},"h":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},".":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"p":{"docs":{},"y":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"j":{"docs":{},"e":{"docs":{},"n":{"docs":{},"k":{"docs":{},"i":{"docs":{},"n":{"docs":{},"s":{"docs":{},"_":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"s":{"docs":{},"p":{"docs":{},"a":{"docs":{},"c":{"docs":{},"e":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"d":{"docs":{},"e":{"docs":{},"v":{"docs":{},"e":{"docs":{},"l":{"docs":{},"o":{"docs":{},"p":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"_":{"docs":{},"i":{"docs":{},"n":{"docs":{},"i":{"docs":{},"t":{"docs":{},".":{"docs":{},"s":{"docs":{},"h":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"[":{"docs":{},"\"":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},"s":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"r":{"docs":{},"e":{"docs":{},"g":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"r":{"docs":{},"y":{"docs":{},".":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},"]":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}},"\\":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.024390243902439025}}},"a":{"docs":{},"l":{"docs":{},"w":{"docs":{},"a":{"docs":{},"y":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}},"p":{"docs":{},"p":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122},"Architecture/App.html":{"ref":"Architecture/App.html","tf":11}},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"i":{"docs":{},"服":{"docs":{},"务":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{},"r":{"docs":{},"y":{"docs":{},"p":{"docs":{},"o":{"docs":{},"i":{"docs":{},"n":{"docs":{},"t":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}}}},"x":{"docs":{},"a":{"docs":{},"m":{"docs":{},"p":{"docs":{},"l":{"docs":{"Examples/":{"ref":"Examples/","tf":1}}}}}}}},"i":{"docs":{},"m":{"docs":{},"a":{"docs":{},"g":{"docs":{},"e":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.03902439024390244}}}}}}},"n":{"docs":{},"d":{"docs":{},"e":{"docs":{},"x":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},".":{"docs":{},"h":{"docs":{},"t":{"docs":{},"m":{"docs":{},"l":{"docs":{},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}},"s":{"docs":{},"t":{"docs":{},"a":{"docs":{},"l":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.05}}}}}}}},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.014634146341463415}},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}},"n":{"docs":{},"a":{"docs":{},"g":{"docs":{},"e":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}},"i":{"docs":{},"r":{"docs":{},"r":{"docs":{},"o":{"docs":{},"r":{"docs":{},"s":{"docs":{},"\"":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.024390243902439025}},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"l":{"docs":{},"a":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}},"一":{"docs":{},"行":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{},"如":{"docs":{},"何":{"docs":{},"安":{"docs":{},"装":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"跟":{"docs":{},"操":{"docs":{},"作":{"docs":{},"系":{"docs":{},"统":{"docs":{},"有":{"docs":{},"关":{"docs":{},",":{"docs":{},"这":{"docs":{},"里":{"docs":{},"就":{"docs":{},"不":{"docs":{},"展":{"docs":{},"开":{"docs":{},"讲":{"docs":{},"了":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"的":{"docs":{},"同":{"docs":{},"学":{"docs":{},"自":{"docs":{},"行":{"docs":{},"百":{"docs":{},"度":{"docs":{},"一":{"docs":{},"下":{"docs":{},"相":{"docs":{},"关":{"docs":{},"教":{"docs":{},"程":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375}}}}}},"p":{"docs":{},"m":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.025}}}}},"p":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.014634146341463415}},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.03902439024390244}}}}}}},"u":{"docs":{},"l":{"docs":{},"l":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}},"i":{"docs":{},"p":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}},"m":{"2":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0625}}},"docs":{}},"y":{"docs":{},"t":{"docs":{},"h":{"docs":{},"o":{"docs":{},"n":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"l":{"docs":{},"a":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}},"s":{"docs":{},"t":{"docs":{},"a":{"docs":{},"r":{"docs":{},"t":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}},"l":{"docs":{},"o":{"docs":{},"a":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"q":{"docs":{},"u":{"docs":{},"i":{"docs":{},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}},"m":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"u":{"docs":{},"n":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125},"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}},"o":{"docs":{},"o":{"docs":{},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"s":{"docs":{},"e":{"docs":{},"r":{"docs":{},"v":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}},"i":{"docs":{},"c":{"docs":{},"e":{"docs":{},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}},"e":{"docs":{},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}},"来":{"docs":{},"进":{"docs":{},"行":{"docs":{},"的":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"是":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"模":{"docs":{},"式":{"docs":{},"。":{"docs":{},"注":{"docs":{},"意":{"docs":{},":":{"docs":{},"强":{"docs":{},"烈":{"docs":{},"不":{"docs":{},"建":{"docs":{},"议":{"docs":{},"在":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"中":{"docs":{},"用":{"docs":{},"预":{"docs":{},"览":{"docs":{},"模":{"docs":{},"式":{"docs":{},"。":{"docs":{},"预":{"docs":{},"览":{"docs":{},"模":{"docs":{},"式":{"docs":{},"只":{"docs":{},"是":{"docs":{},"让":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"快":{"docs":{},"速":{"docs":{},"体":{"docs":{},"验":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"以":{"docs":{},"及":{"docs":{},"调":{"docs":{},"试":{"docs":{},"代":{"docs":{},"码":{"docs":{},"问":{"docs":{},"题":{"docs":{},"的":{"docs":{},"一":{"docs":{},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},",":{"docs":{},"而":{"docs":{},"不":{"docs":{},"是":{"docs":{},"用":{"docs":{},"作":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"部":{"docs":{},"署":{"docs":{},"的":{"docs":{},"。":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"t":{"docs":{},"a":{"docs":{},"r":{"docs":{},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375}}}}}},"u":{"docs":{},"d":{"docs":{},"o":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"t":{"docs":{},"i":{"docs":{},"k":{"docs":{},"a":{"docs":{},"z":{"docs":{},"y":{"docs":{},"q":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}},":":{"docs":{},"l":{"docs":{},"a":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.024390243902439025}}}}}}}}}}}}}}}}}}}}}}}},"u":{"docs":{},"p":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"v":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"e":{"docs":{},"r":{"docs":{},"s":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}},"o":{"docs":{},"l":{"docs":{},"u":{"docs":{},"m":{"docs":{},"n":{"docs":{},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"1":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"2":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},",":{"docs":{},"他":{"docs":{},"们":{"docs":{},"通":{"docs":{},"过":{"docs":{},"连":{"docs":{},"接":{"docs":{},"到":{"docs":{},"配":{"docs":{},"置":{"docs":{},"好":{"docs":{},"的":{"docs":{},"b":{"docs":{},"r":{"docs":{},"o":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"(":{"docs":{},"通":{"docs":{},"常":{"docs":{},"是":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},")":{"docs":{},"来":{"docs":{},"进":{"docs":{},"行":{"docs":{},"与":{"docs":{},"主":{"docs":{},"机":{"docs":{},"的":{"docs":{},"通":{"docs":{},"信":{"docs":{},"。":{"docs":{"Usage/Node/View.html":{"ref":"Usage/Node/View.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"{":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}},"}":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}},"下":{"docs":{},"载":{"docs":{},"镜":{"docs":{},"像":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}},"其":{"docs":{},"中":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"映":{"docs":{},"射":{"docs":{},"了":{"8":{"0":{"8":{"0":{"docs":{},"端":{"docs":{},"口":{"docs":{},"(":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"前":{"docs":{},"端":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},")":{"docs":{},"以":{"docs":{},"及":{"8":{"0":{"0":{"0":{"docs":{},"端":{"docs":{},"口":{"docs":{},"(":{"docs":{},"后":{"docs":{},"端":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},")":{"docs":{},"到":{"docs":{},"宿":{"docs":{},"主":{"docs":{},"机":{"docs":{},"。":{"docs":{},"另":{"docs":{},"外":{"docs":{},"还":{"docs":{},"将":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"和":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"映":{"docs":{},"射":{"docs":{},"到":{"docs":{},"了":{"docs":{},"容":{"docs":{},"器":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},"。":{"docs":{},"传":{"docs":{},"入":{"docs":{},"参":{"docs":{},"数":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"是":{"docs":{},"代":{"docs":{},"表":{"docs":{},"该":{"docs":{},"启":{"docs":{},"动":{"docs":{},"方":{"docs":{},"式":{"docs":{},"为":{"docs":{},"主":{"docs":{},"机":{"docs":{},"启":{"docs":{},"动":{"docs":{},"模":{"docs":{},"式":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"所":{"docs":{},"有":{"docs":{},"服":{"docs":{},"务":{"docs":{},"(":{"docs":{},"前":{"docs":{},"端":{"docs":{},"、":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"、":{"docs":{},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{},"、":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},")":{"docs":{},"都":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"docs":{},"。":{"docs":{},"另":{"docs":{},"外":{"docs":{},"一":{"docs":{},"个":{"docs":{},"模":{"docs":{},"式":{"docs":{},"是":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"模":{"docs":{},"式":{"docs":{},",":{"docs":{},"只":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"docs":{},"必":{"docs":{},"要":{"docs":{},"的":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"和":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"服":{"docs":{},"务":{"docs":{},",":{"docs":{},"这":{"docs":{},"个":{"docs":{},"对":{"docs":{},"于":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"部":{"docs":{},"署":{"docs":{},"比":{"docs":{},"较":{"docs":{},"有":{"docs":{},"用":{"docs":{},"。":{"docs":{},"等":{"docs":{},"待":{"docs":{},"大":{"docs":{},"约":{"2":{"0":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}},"r":{"docs":{},"o":{"docs":{},"o":{"docs":{},"t":{"docs":{},"是":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},"的":{"docs":{},"根":{"docs":{},"目":{"docs":{},"录":{"docs":{},",":{"docs":{},"这":{"docs":{},"里":{"docs":{},"是":{"docs":{},"n":{"docs":{},"p":{"docs":{},"m":{"docs":{},"打":{"docs":{},"包":{"docs":{},"好":{"docs":{},"后":{"docs":{},"的":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}},"者":{"docs":{},"可":{"docs":{},"以":{"docs":{},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"和":{"docs":{},"创":{"docs":{},"建":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"来":{"docs":{},"添":{"docs":{},"加":{"docs":{},",":{"docs":{},"后":{"docs":{},"者":{"docs":{},"由":{"docs":{},"于":{"docs":{},"没":{"docs":{},"有":{"docs":{},"源":{"docs":{},"代":{"docs":{},"码":{"docs":{},",":{"docs":{},"只":{"docs":{},"能":{"docs":{},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"来":{"docs":{},"添":{"docs":{},"加":{"docs":{},"。":{"docs":{"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"同":{"docs":{},"样":{"docs":{},",":{"docs":{},"在":{"docs":{},"浏":{"docs":{},"览":{"docs":{},"器":{"docs":{},"中":{"docs":{},"输":{"docs":{},"入":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"界":{"docs":{},"面":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}},"面":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"让":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"运":{"docs":{},"行":{"docs":{},"在":{"docs":{},"各":{"docs":{},"个":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"让":{"docs":{},"主":{"docs":{},"机":{"docs":{},"与":{"docs":{},"节":{"docs":{},"点":{"docs":{},"进":{"docs":{},"行":{"docs":{},"通":{"docs":{},"信":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"需":{"docs":{},"要":{"docs":{},"知":{"docs":{},"道":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},"和":{"docs":{},"端":{"docs":{},"口":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"手":{"docs":{},"动":{"docs":{},"配":{"docs":{},"置":{"docs":{},"一":{"docs":{},"下":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"和":{"docs":{},"端":{"docs":{},"口":{"docs":{},"。":{"docs":{},"在":{"docs":{},"节":{"docs":{},"点":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},"点":{"docs":{},"击":{"docs":{},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"里":{"docs":{},"的":{"docs":{},"蓝":{"docs":{},"色":{"docs":{},"查":{"docs":{},"看":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"节":{"docs":{},"点":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{},"节":{"docs":{},"点":{"docs":{},"详":{"docs":{},"情":{"docs":{},"样":{"docs":{},"子":{"docs":{},"如":{"docs":{},"下":{"docs":{},"。":{"docs":{"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":0.25}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"模":{"docs":{},"式":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}},"对":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"不":{"docs":{},"了":{"docs":{},"解":{"docs":{},"的":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"参":{"docs":{},"考":{"docs":{},"一":{"docs":{},"下":{"docs":{},"这":{"docs":{},"篇":{"docs":{},"文":{"docs":{},"章":{"docs":{},"(":{"9":{"1":{"0":{"2":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}},"于":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"配":{"docs":{},"置":{"docs":{},"标":{"docs":{},"签":{"docs":{},"下":{"docs":{},"点":{"docs":{},"击":{"docs":{},"运":{"docs":{},"行":{"docs":{},"按":{"docs":{},"钮":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}}}}},"年":{"docs":{},"了":{"docs":{},",":{"docs":{},"学":{"docs":{},"点":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}},"当":{"docs":{},"然":{"docs":{},",":{"docs":{},"也":{"docs":{},"可":{"docs":{},"以":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}},"我":{"docs":{},"们":{"docs":{},"已":{"docs":{},"经":{"docs":{},"在":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},"上":{"docs":{},"构":{"docs":{},"建":{"docs":{},"了":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},",":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"将":{"docs":{},"其":{"docs":{},"p":{"docs":{},"u":{"docs":{},"l":{"docs":{},"l":{"docs":{},"下":{"docs":{},"来":{"docs":{},"使":{"docs":{},"用":{"docs":{},"。":{"docs":{},"在":{"docs":{},"p":{"docs":{},"u":{"docs":{},"l":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"有":{"docs":{},"两":{"docs":{},"种":{"docs":{},"运":{"docs":{},"行":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"将":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"下":{"docs":{},"载":{"docs":{},"下":{"docs":{},"来":{"docs":{},"。":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"大":{"docs":{},"小":{"docs":{},"大":{"docs":{},"概":{"docs":{},"在":{"docs":{},"几":{"docs":{},"百":{"docs":{},"兆":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"下":{"docs":{},"载":{"docs":{},"需":{"docs":{},"要":{"docs":{},"几":{"docs":{},"分":{"docs":{},"钟":{"docs":{},"时":{"docs":{},"间":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"拷":{"docs":{},"贝":{"docs":{},"一":{"docs":{},"份":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"以":{"docs":{},"及":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"到":{"docs":{},"某":{"docs":{},"一":{"docs":{},"个":{"docs":{},"地":{"docs":{},"方":{"docs":{},"。":{"docs":{},"例":{"docs":{},"如":{"docs":{},"我":{"docs":{},"的":{"docs":{},"例":{"docs":{},"子":{"docs":{},",":{"docs":{},"分":{"docs":{},"别":{"docs":{},"为":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"和":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"更":{"docs":{},"改":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},",":{"docs":{},"将":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"、":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"的":{"docs":{},"指":{"docs":{},"向":{"docs":{},"i":{"docs":{},"p":{"docs":{},"更":{"docs":{},"改":{"docs":{},"为":{"docs":{},"自":{"docs":{},"己":{"docs":{},"数":{"docs":{},"据":{"docs":{},"的":{"docs":{},"值":{"docs":{},"。":{"docs":{},"注":{"docs":{},"意":{"docs":{},",":{"docs":{},"容":{"docs":{},"器":{"docs":{},"中":{"docs":{},"对":{"docs":{},"应":{"docs":{},"的":{"docs":{},"宿":{"docs":{},"主":{"docs":{},"机":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},"不":{"docs":{},"是":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},",":{"docs":{},"而":{"docs":{},"是":{"1":{"7":{"2":{"docs":{},".":{"1":{"7":{"docs":{},".":{"0":{"docs":{},".":{"1":{"docs":{},"(":{"docs":{},"当":{"docs":{},"然":{"docs":{},"也":{"docs":{},"可":{"docs":{},"以":{"docs":{},"用":{"docs":{},"n":{"docs":{},"e":{"docs":{},"t":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"来":{"docs":{},"做":{"docs":{},",":{"docs":{},"只":{"docs":{},"是":{"docs":{},"稍":{"docs":{},"微":{"docs":{},"麻":{"docs":{},"烦":{"docs":{},"一":{"docs":{},"些":{"docs":{},")":{"docs":{},"。":{"docs":{},"更":{"docs":{},"改":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},",":{"docs":{},"将":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"地":{"docs":{},"址":{"docs":{},"v":{"docs":{},"u":{"docs":{},"e":{"docs":{},"_":{"docs":{},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},"_":{"docs":{},"b":{"docs":{},"a":{"docs":{},"s":{"docs":{},"e":{"docs":{},"_":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"更":{"docs":{},"改":{"docs":{},"为":{"docs":{},"宿":{"docs":{},"主":{"docs":{},"机":{"docs":{},"所":{"docs":{},"在":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"1":{"9":{"2":{"docs":{},".":{"1":{"6":{"8":{"docs":{},".":{"0":{"docs":{},".":{"8":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},",":{"docs":{},"这":{"docs":{},"将":{"docs":{},"是":{"docs":{},"前":{"docs":{},"端":{"docs":{},"调":{"docs":{},"用":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"会":{"docs":{},"用":{"docs":{},"到":{"docs":{},"的":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}},"docs":{}}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"好":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"接":{"docs":{},"下":{"docs":{},"来":{"docs":{},"就":{"docs":{},"是":{"docs":{},"运":{"docs":{},"行":{"docs":{},"容":{"docs":{},"器":{"docs":{},"了":{"docs":{},"。":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"来":{"docs":{},"启":{"docs":{},"动":{"docs":{},"容":{"docs":{},"器":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}},"知":{"docs":{},"识":{"docs":{},")":{"docs":{},"做":{"docs":{},"进":{"docs":{},"一":{"docs":{},"步":{"docs":{},"了":{"docs":{},"解":{"docs":{},"。":{"docs":{},"简":{"docs":{},"单":{"docs":{},"来":{"docs":{},"说":{"docs":{},",":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"可":{"docs":{},"以":{"docs":{},"利":{"docs":{},"用":{"docs":{},"已":{"docs":{},"存":{"docs":{},"在":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"构":{"docs":{},"建":{"docs":{},"一":{"docs":{},"些":{"docs":{},"常":{"docs":{},"用":{"docs":{},"的":{"docs":{},"服":{"docs":{},"务":{"docs":{},"和":{"docs":{},"应":{"docs":{},"用":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"、":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"、":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"等":{"docs":{},"等":{"docs":{},"。":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"运":{"docs":{},"行":{"docs":{},"一":{"docs":{},"个":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"服":{"docs":{},"务":{"docs":{},"仅":{"docs":{},"需":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"运":{"docs":{},"行":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"容":{"docs":{},"器":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":10.090909090909092}}}}}},"这":{"docs":{},"应":{"docs":{},"该":{"docs":{},"是":{"docs":{},"部":{"docs":{},"署":{"docs":{},"应":{"docs":{},"用":{"docs":{},"的":{"docs":{},"最":{"docs":{},"方":{"docs":{},"便":{"docs":{},"也":{"docs":{},"是":{"docs":{},"最":{"docs":{},"节":{"docs":{},"省":{"docs":{},"时":{"docs":{},"间":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"了":{"docs":{},"。":{"docs":{},"在":{"docs":{},"最":{"docs":{},"近":{"docs":{},"的":{"docs":{},"一":{"docs":{},"次":{"docs":{},"版":{"docs":{},"本":{"docs":{},"更":{"docs":{},"新":{"docs":{},"v":{"0":{"docs":{},".":{"2":{"docs":{},".":{"3":{"docs":{},"中":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"发":{"docs":{},"布":{"docs":{},"了":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"让":{"docs":{},"大":{"docs":{},"家":{"docs":{},"可":{"docs":{},"以":{"docs":{},"利":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"来":{"docs":{},"轻":{"docs":{},"松":{"docs":{},"部":{"docs":{},"署":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{},"下":{"docs":{},"面":{"docs":{},"将":{"docs":{},"一":{"docs":{},"步":{"docs":{},"一":{"docs":{},"步":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"如":{"docs":{},"何":{"docs":{},"使":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"来":{"docs":{},"部":{"docs":{},"署":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}},"docs":{}}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"样":{"docs":{},"的":{"docs":{},"话":{"docs":{},",":{"docs":{},"p":{"docs":{},"u":{"docs":{},"l":{"docs":{},"l":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"的":{"docs":{},"速":{"docs":{},"度":{"docs":{},"会":{"docs":{},"比":{"docs":{},"不":{"docs":{},"改":{"docs":{},"变":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"源":{"docs":{},"的":{"docs":{},"速":{"docs":{},"度":{"docs":{},"快":{"docs":{},"很":{"docs":{},"多":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}},",":{"docs":{},"p":{"docs":{},"m":{"2":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"3":{"docs":{},"个":{"docs":{},"守":{"docs":{},"护":{"docs":{},"进":{"docs":{},"程":{"docs":{},"来":{"docs":{},"管":{"docs":{},"理":{"docs":{},"这":{"3":{"docs":{},"个":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"如":{"docs":{},"果":{"docs":{},"想":{"docs":{},"看":{"docs":{},"后":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"的":{"docs":{},"日":{"docs":{},"志":{"docs":{},"的":{"docs":{},"话":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}}}}}}}}}},"docs":{}}}}},"docs":{}}},"我":{"docs":{},"们":{"docs":{},"就":{"docs":{},"完":{"docs":{},"成":{"docs":{},"了":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"配":{"docs":{},"置":{"docs":{},"工":{"docs":{},"作":{"docs":{},"。":{"docs":{"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":0.25}}}}}}}}}}}}}}}}}},"里":{"docs":{},"先":{"docs":{},"定":{"docs":{},"义":{"docs":{},"了":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"主":{"docs":{},"节":{"docs":{},"点":{"docs":{},"。":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"依":{"docs":{},"赖":{"docs":{},"于":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"和":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"容":{"docs":{},"器":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"在":{"docs":{},"启":{"docs":{},"动":{"docs":{},"之":{"docs":{},"前":{"docs":{},"会":{"docs":{},"同":{"docs":{},"时":{"docs":{},"启":{"docs":{},"动":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"和":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"容":{"docs":{},"器":{"docs":{},"。":{"docs":{},"这":{"docs":{},"样":{"docs":{},"就":{"docs":{},"不":{"docs":{},"需":{"docs":{},"要":{"docs":{},"单":{"docs":{},"独":{"docs":{},"配":{"docs":{},"置":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"和":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"服":{"docs":{},"务":{"docs":{},"了":{"docs":{},",":{"docs":{},"大":{"docs":{},"大":{"docs":{},"节":{"docs":{},"省":{"docs":{},"了":{"docs":{},"环":{"docs":{},"境":{"docs":{},"配":{"docs":{},"置":{"docs":{},"的":{"docs":{},"时":{"docs":{},"间":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"启":{"docs":{},"动":{"docs":{},"了":{"docs":{},"多":{"docs":{},"增":{"docs":{},"加":{"docs":{},"了":{"docs":{},"两":{"docs":{},"个":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},",":{"docs":{},"以":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"模":{"docs":{},"式":{"docs":{},"启":{"docs":{},"动":{"docs":{},"。":{"docs":{},"这":{"docs":{},"样":{"docs":{},",":{"docs":{},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"部":{"docs":{},"署":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"部":{"docs":{},"署":{"docs":{},"就":{"docs":{},"完":{"docs":{},"成":{"docs":{},"了":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"指":{"docs":{},"启":{"docs":{},"动":{"docs":{},"后":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"用":{"docs":{},"p":{"docs":{},"m":{"2":{"docs":{},"来":{"docs":{},"管":{"docs":{},"理":{"docs":{},"进":{"docs":{},"程":{"docs":{},"。":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}},"docs":{}}}}}}}}}}}}}}},"的":{"docs":{},"构":{"docs":{},"建":{"docs":{},"是":{"docs":{},"指":{"docs":{},"前":{"docs":{},"端":{"docs":{},"构":{"docs":{},"建":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"是":{"docs":{},"指":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"部":{"docs":{},"署":{"docs":{},",":{"docs":{},"因":{"docs":{},"为":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"已":{"docs":{},"经":{"docs":{},"内":{"docs":{},"嵌":{"docs":{},"到":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"中":{"docs":{},"了":{"docs":{},",":{"docs":{},"所":{"docs":{},"有":{"docs":{},"节":{"docs":{},"点":{"docs":{},"都":{"docs":{},"可":{"docs":{},"以":{"docs":{},"使":{"docs":{},"用":{"docs":{},",":{"docs":{},"不":{"docs":{},"需":{"docs":{},"要":{"docs":{},"额":{"docs":{},"外":{"docs":{},"部":{"docs":{},"署":{"docs":{},"。":{"docs":{},"简":{"docs":{},"单":{"docs":{},"来":{"docs":{},"说":{"docs":{},",":{"docs":{},"就":{"docs":{},"是":{"docs":{},"将":{"docs":{},"主":{"docs":{},"机":{"docs":{},"上":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"源":{"docs":{},"代":{"docs":{},"码":{"docs":{},"通":{"docs":{},"过":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"打":{"docs":{},"包":{"docs":{},"传":{"docs":{},"输":{"docs":{},"至":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"节":{"docs":{},"点":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"运":{"docs":{},"行":{"docs":{},"传":{"docs":{},"输":{"docs":{},"过":{"docs":{},"来":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"已":{"docs":{},"经":{"docs":{},"有":{"docs":{},"一":{"docs":{},"些":{"docs":{},"配":{"docs":{},"置":{"docs":{},"好":{"docs":{},"的":{"docs":{},"初":{"docs":{},"始":{"docs":{},"输":{"docs":{},"入":{"docs":{},"项":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"简":{"docs":{},"单":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"一":{"docs":{},"下":{"docs":{},"各":{"docs":{},"自":{"docs":{},"的":{"docs":{},"含":{"docs":{},"义":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"我":{"docs":{},"们":{"docs":{},"选":{"docs":{},"择":{"docs":{},"列":{"docs":{},"表":{"docs":{},"+":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}},"个":{"docs":{},"方":{"docs":{},"式":{"docs":{},"稍":{"docs":{},"微":{"docs":{},"有":{"docs":{},"些":{"docs":{},"繁":{"docs":{},"琐":{"docs":{},",":{"docs":{},"但":{"docs":{},"是":{"docs":{},"对":{"docs":{},"于":{"docs":{},"无":{"docs":{},"法":{"docs":{},"轻":{"docs":{},"松":{"docs":{},"获":{"docs":{},"取":{"docs":{},"服":{"docs":{},"务":{"docs":{},"器":{"docs":{},"的":{"docs":{},"读":{"docs":{},"写":{"docs":{},"权":{"docs":{},"限":{"docs":{},"时":{"docs":{},"是":{"docs":{},"非":{"docs":{},"常":{"docs":{},"有":{"docs":{},"用":{"docs":{},"的":{"docs":{},",":{"docs":{},"适":{"docs":{},"合":{"docs":{},"在":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"上":{"docs":{},"使":{"docs":{},"用":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"默":{"docs":{},"认":{"docs":{},"是":{"docs":{},"开":{"docs":{},"启":{"docs":{},"的":{"docs":{},"。":{"docs":{},"如":{"docs":{},"果":{"docs":{},"开":{"docs":{},"启":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"将":{"docs":{},"先":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"网":{"docs":{},"站":{"docs":{},"的":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},".":{"docs":{},"t":{"docs":{},"x":{"docs":{},"t":{"docs":{},"并":{"docs":{},"判":{"docs":{},"断":{"docs":{},"页":{"docs":{},"面":{"docs":{},"是":{"docs":{},"否":{"docs":{},"可":{"docs":{},"抓":{"docs":{},";":{"docs":{},"否":{"docs":{},"则":{"docs":{},",":{"docs":{},"不":{"docs":{},"会":{"docs":{},"对":{"docs":{},"此":{"docs":{},"进":{"docs":{},"行":{"docs":{},"验":{"docs":{},"证":{"docs":{},"。":{"docs":{},"用":{"docs":{},"户":{"docs":{},"可":{"docs":{},"以":{"docs":{},"选":{"docs":{},"择":{"docs":{},"将":{"docs":{},"其":{"docs":{},"关":{"docs":{},"闭":{"docs":{},"。":{"docs":{},"请":{"docs":{},"注":{"docs":{},"意":{"docs":{},",":{"docs":{},"任":{"docs":{},"何":{"docs":{},"无":{"docs":{},"视":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},"协":{"docs":{},"议":{"docs":{},"的":{"docs":{},"行":{"docs":{},"为":{"docs":{},"都":{"docs":{},"有":{"docs":{},"法":{"docs":{},"律":{"docs":{},"风":{"docs":{},"险":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},"非":{"docs":{},"常":{"docs":{},"方":{"docs":{},"便":{"docs":{},",":{"docs":{},"但":{"docs":{},"是":{"docs":{},"需":{"docs":{},"要":{"docs":{},"获":{"docs":{},"得":{"docs":{},"主":{"docs":{},"机":{"docs":{},"服":{"docs":{},"务":{"docs":{},"器":{"docs":{},"的":{"docs":{},"读":{"docs":{},"写":{"docs":{},"权":{"docs":{},"限":{"docs":{},",":{"docs":{},"因":{"docs":{},"而":{"docs":{},"比":{"docs":{},"较":{"docs":{},"适":{"docs":{},"合":{"docs":{},"在":{"docs":{},"开":{"docs":{},"发":{"docs":{},"环":{"docs":{},"境":{"docs":{},"上":{"docs":{},"采":{"docs":{},"用":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"也":{"docs":{},"是":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"采":{"docs":{},"用":{"docs":{},"的":{"docs":{},"策":{"docs":{},"略":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"网":{"docs":{},"页":{"docs":{},"是":{"docs":{},"如":{"docs":{},"何":{"docs":{},"进":{"docs":{},"行":{"docs":{},"的":{"docs":{},"。":{"docs":{},"作":{"docs":{},"为":{"docs":{},"第":{"docs":{},"一":{"docs":{},"个":{"docs":{},"版":{"docs":{},"本":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"有":{"docs":{},"仅":{"docs":{},"列":{"docs":{},"表":{"docs":{},"、":{"docs":{},"仅":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"、":{"docs":{},"列":{"docs":{},"表":{"docs":{},"+":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"些":{"docs":{},"都":{"docs":{},"是":{"docs":{},"再":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},"或":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"中":{"docs":{},"需":{"docs":{},"要":{"docs":{},"提":{"docs":{},"取":{"docs":{},"的":{"docs":{},"字":{"docs":{},"段":{"docs":{},"。":{"docs":{},"字":{"docs":{},"段":{"docs":{},"由":{"docs":{},"c":{"docs":{},"s":{"docs":{},"s":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{},"或":{"docs":{},"者":{"docs":{},"x":{"docs":{},"p":{"docs":{},"a":{"docs":{},"t":{"docs":{},"h":{"docs":{},"来":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"提":{"docs":{},"取":{"docs":{},"。":{"docs":{},"可":{"docs":{},"以":{"docs":{},"选":{"docs":{},"择":{"docs":{},"文":{"docs":{},"本":{"docs":{},"或":{"docs":{},"者":{"docs":{},"属":{"docs":{},"性":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"镜":{"docs":{},"像":{"docs":{},"之":{"docs":{},"前":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"配":{"docs":{},"置":{"docs":{},"一":{"docs":{},"下":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"源":{"docs":{},"。":{"docs":{},"因":{"docs":{},"为":{"docs":{},"我":{"docs":{},"们":{"docs":{},"在":{"docs":{},"墙":{"docs":{},"内":{"docs":{},",":{"docs":{},"使":{"docs":{},"用":{"docs":{},"原":{"docs":{},"有":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"源":{"docs":{},"速":{"docs":{},"度":{"docs":{},"非":{"docs":{},"常":{"docs":{},"感":{"docs":{},"人":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"将":{"docs":{},"使":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},"在":{"docs":{},"国":{"docs":{},"内":{"docs":{},"的":{"docs":{},"加":{"docs":{},"速":{"docs":{},"器":{"docs":{},"。":{"docs":{},"创":{"docs":{},"建":{"docs":{},"/":{"docs":{},"e":{"docs":{},"t":{"docs":{},"c":{"docs":{},"/":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"/":{"docs":{},"d":{"docs":{},"a":{"docs":{},"e":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},".":{"docs":{},"j":{"docs":{},"s":{"docs":{},"o":{"docs":{},"n":{"docs":{},"文":{"docs":{},"件":{"docs":{},",":{"docs":{},"在":{"docs":{},"其":{"docs":{},"中":{"docs":{},"输":{"docs":{},"入":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},".":{"docs":{},".":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}},"b":{"docs":{},"u":{"docs":{},"i":{"docs":{},"l":{"docs":{},"d":{"docs":{},":":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}},"g":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"i":{"docs":{},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},"s":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"g":{"docs":{},"i":{"docs":{},"t":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"m":{"docs":{},"/":{"docs":{},"t":{"docs":{},"i":{"docs":{},"k":{"docs":{},"a":{"docs":{},"z":{"docs":{},"y":{"docs":{},"q":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"l":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}},"o":{"docs":{},"g":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"y":{"docs":{},"a":{"docs":{},"r":{"docs":{},"n":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.025}}}}}},"分":{"docs":{},"别":{"docs":{},"配":{"docs":{},"置":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"和":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"。":{"docs":{},"分":{"docs":{},"别":{"docs":{},"需":{"docs":{},"要":{"docs":{},"对":{"docs":{},"部":{"docs":{},"署":{"docs":{},"后":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"地":{"docs":{},"址":{"docs":{},"以":{"docs":{},"及":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"地":{"docs":{},"址":{"docs":{},"进":{"docs":{},"行":{"docs":{},"配":{"docs":{},"置":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"页":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}},"启":{"docs":{},"动":{"docs":{},"服":{"docs":{},"务":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"拉":{"docs":{},"取":{"docs":{},"代":{"docs":{},"码":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"构":{"docs":{},"建":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"完":{"docs":{},"成":{"docs":{},"后":{"docs":{},",":{"docs":{},"会":{"docs":{},"在":{"docs":{},".":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},"创":{"docs":{},"建":{"docs":{},"一":{"docs":{},"个":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"文":{"docs":{},"件":{"docs":{},"夹":{"docs":{},",":{"docs":{},"里":{"docs":{},"面":{"docs":{},"是":{"docs":{},"打":{"docs":{},"包":{"docs":{},"好":{"docs":{},"后":{"docs":{},"的":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"添":{"docs":{},"加":{"docs":{},"/":{"docs":{},"e":{"docs":{},"t":{"docs":{},"c":{"docs":{},"/":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},".":{"docs":{},"d":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"文":{"docs":{},"件":{"docs":{},",":{"docs":{},"输":{"docs":{},"入":{"docs":{},"以":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"完":{"docs":{},"成":{"docs":{},"后":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"刚":{"docs":{},"刚":{"docs":{},"添":{"docs":{},"加":{"docs":{},"的":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"出":{"docs":{},"现":{"docs":{},"了":{"docs":{},"在":{"docs":{},"最":{"docs":{},"下":{"docs":{},"方":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"查":{"docs":{},"看":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}},"然":{"docs":{},"后":{"docs":{},"在":{"docs":{},"浏":{"docs":{},"览":{"docs":{},"器":{"docs":{},"中":{"docs":{},"输":{"docs":{},"入":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"界":{"docs":{},"面":{"docs":{},"了":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}},",":{"docs":{},"在":{"docs":{},"侧":{"docs":{},"边":{"docs":{},"栏":{"docs":{},"点":{"docs":{},"击":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"添":{"docs":{},"加":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"选":{"docs":{},"择":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"上":{"docs":{},"传":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"选":{"docs":{},"择":{"docs":{},"刚":{"docs":{},"刚":{"docs":{},"打":{"docs":{},"包":{"docs":{},"好":{"docs":{},"的":{"docs":{},"z":{"docs":{},"i":{"docs":{},"p":{"docs":{},"文":{"docs":{},"件":{"docs":{},"。":{"docs":{},"上":{"docs":{},"传":{"docs":{},"成":{"docs":{},"功":{"docs":{},"后":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},"会":{"docs":{},"出":{"docs":{},"现":{"docs":{},"新":{"docs":{},"添":{"docs":{},"加":{"docs":{},"的":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"。":{"docs":{},"这":{"docs":{},"样":{"docs":{},"就":{"docs":{},"算":{"docs":{},"添":{"docs":{},"加":{"docs":{},"好":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"会":{"docs":{},"提":{"docs":{},"示":{"docs":{},"任":{"docs":{},"务":{"docs":{},"已":{"docs":{},"经":{"docs":{},"派":{"docs":{},"发":{"docs":{},"到":{"docs":{},"队":{"docs":{},"列":{"docs":{},"中":{"docs":{},"去":{"docs":{},"了":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"你":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"左":{"docs":{},"侧":{"docs":{},"看":{"docs":{},"到":{"docs":{},"新":{"docs":{},"创":{"docs":{},"建":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"点":{"docs":{},"击":{"docs":{},"创":{"docs":{},"建":{"docs":{},"时":{"docs":{},"间":{"docs":{},"可":{"docs":{},"以":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"现":{"docs":{},"在":{"docs":{},",":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"启":{"docs":{},"动":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"服":{"docs":{},"务":{"docs":{},"就":{"docs":{},"完":{"docs":{},"成":{"docs":{},"了":{"docs":{},"启":{"docs":{},"动":{"docs":{},"前":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}},"配":{"docs":{},"置":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667},"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}},"该":{"docs":{},"模":{"docs":{},"式":{"docs":{},"同":{"docs":{},"样":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"3":{"docs":{},"个":{"docs":{},"后":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"和":{"1":{"docs":{},"个":{"docs":{},"前":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{},"前":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"是":{"docs":{},"通":{"docs":{},"过":{"docs":{},"n":{"docs":{},"p":{"docs":{},"m":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}}}}}}}}}}},"docs":{}}}}}}}},"docs":{}}}}}}}}},"任":{"docs":{},"务":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Task/":{"ref":"Usage/Task/","tf":10}}}},"使":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Usage/":{"ref":"Usage/","tf":10}}}}}}}}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":10}},"触":{"docs":{},"发":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.18181818181818182}},"是":{"docs":{},"比":{"docs":{},"较":{"docs":{},"常":{"docs":{},"用":{"docs":{},"的":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"对":{"docs":{},"于":{"docs":{},"增":{"docs":{},"量":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"或":{"docs":{},"对":{"docs":{},"实":{"docs":{},"时":{"docs":{},"性":{"docs":{},"有":{"docs":{},"要":{"docs":{},"求":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"很":{"docs":{},"重":{"docs":{},"要":{"docs":{},"。":{"docs":{},"这":{"docs":{},"在":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"中":{"docs":{},"会":{"docs":{},"详":{"docs":{},"细":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"。":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Spider/":{"ref":"Usage/Spider/","tf":10.142857142857142}},"就":{"docs":{},"是":{"docs":{},"我":{"docs":{},"们":{"docs":{},"通":{"docs":{},"常":{"docs":{},"说":{"docs":{},"的":{"docs":{},"网":{"docs":{},"络":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},",":{"docs":{},"本":{"docs":{},"小":{"docs":{},"节":{"docs":{},"将":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},":":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}},"最":{"docs":{},"开":{"docs":{},"始":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"的":{"docs":{},"网":{"docs":{},"址":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}},"节":{"docs":{},"点":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Node/":{"ref":"Usage/Node/","tf":10.25}},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"中":{"docs":{},"的":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"。":{"docs":{},"一":{"docs":{},"个":{"docs":{},"节":{"docs":{},"点":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"会":{"docs":{},"连":{"docs":{},"接":{"docs":{},"到":{"docs":{},"一":{"docs":{},"个":{"docs":{},"任":{"docs":{},"务":{"docs":{},"队":{"docs":{},"列":{"docs":{},"(":{"docs":{},"例":{"docs":{},"如":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},")":{"docs":{},"来":{"docs":{},"接":{"docs":{},"收":{"docs":{},"和":{"docs":{},"运":{"docs":{},"行":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"需":{"docs":{},"要":{"docs":{},"在":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"被":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},",":{"docs":{},"用":{"docs":{},"户":{"docs":{},"在":{"docs":{},"部":{"docs":{},"署":{"docs":{},"前":{"docs":{},"需":{"docs":{},"要":{"docs":{},"定":{"docs":{},"义":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},"和":{"docs":{},"端":{"docs":{},"口":{"docs":{},"(":{"docs":{},"默":{"docs":{},"认":{"docs":{},"为":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},")":{"docs":{},"。":{"docs":{"Usage/Node/":{"ref":"Usage/Node/","tf":0.25}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"修":{"docs":{},"改":{"docs":{},"节":{"docs":{},"点":{"docs":{},"信":{"docs":{},"息":{"docs":{"Usage/Node/":{"ref":"Usage/Node/","tf":0.25},"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":10.25}}}}}}}},"点":{"docs":{},"击":{"docs":{},"侧":{"docs":{},"边":{"docs":{},"栏":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"节":{"docs":{},"点":{"docs":{},"列":{"docs":{},"表":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"已":{"docs":{},"上":{"docs":{},"线":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"。":{"docs":{},"这":{"docs":{},"里":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"已":{"docs":{},"经":{"docs":{},"运":{"docs":{},"行":{"docs":{},"起":{"docs":{},"来":{"docs":{},"的":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"i":{"docs":{"Usage/Node/View.html":{"ref":"Usage/Node/View.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"保":{"docs":{},"存":{"docs":{},"、":{"docs":{},"预":{"docs":{},"览":{"docs":{},",":{"docs":{},"查":{"docs":{},"看":{"docs":{},"预":{"docs":{},"览":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}},"配":{"docs":{},"置":{"docs":{},"标":{"docs":{},"签":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"配":{"docs":{},"置":{"docs":{},"页":{"docs":{},"面":{"docs":{},"。":{"docs":{},"接":{"docs":{},"下":{"docs":{},"来":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"对":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"规":{"docs":{},"则":{"docs":{},"进":{"docs":{},"行":{"docs":{},"配":{"docs":{},"置":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"在":{"docs":{},"右":{"docs":{},"侧":{"docs":{},"分":{"docs":{},"别":{"docs":{},"输":{"docs":{},"入":{"docs":{},"该":{"docs":{},"节":{"docs":{},"点":{"docs":{},"对":{"docs":{},"应":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"i":{"docs":{},"p":{"docs":{},"和":{"docs":{},"节":{"docs":{},"点":{"docs":{},"端":{"docs":{},"口":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"点":{"docs":{},"击":{"docs":{},"保":{"docs":{},"存":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"保":{"docs":{},"存":{"docs":{},"该":{"docs":{},"节":{"docs":{},"点":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":0.25}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"中":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"配":{"docs":{},"置":{"docs":{},"一":{"docs":{},"下":{"docs":{},"执":{"docs":{},"行":{"docs":{},"命":{"docs":{},"令":{"docs":{},"(":{"docs":{},"运":{"docs":{},"行":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"时":{"docs":{},"后":{"docs":{},"台":{"docs":{},"执":{"docs":{},"行":{"docs":{},"的":{"docs":{},"s":{"docs":{},"h":{"docs":{},"e":{"docs":{},"l":{"docs":{},"l":{"docs":{},"命":{"docs":{},"令":{"docs":{},")":{"docs":{},"和":{"docs":{},"结":{"docs":{},"果":{"docs":{},"集":{"docs":{},"(":{"docs":{},"通":{"docs":{},"过":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"l":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"传":{"docs":{},"递":{"docs":{},"给":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"程":{"docs":{},"序":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"程":{"docs":{},"序":{"docs":{},"存":{"docs":{},"储":{"docs":{},"结":{"docs":{},"果":{"docs":{},"的":{"docs":{},"地":{"docs":{},"方":{"docs":{},")":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"点":{"docs":{},"击":{"docs":{},"保":{"docs":{},"存":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"保":{"docs":{},"存":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"上":{"docs":{},"传":{"docs":{},"之":{"docs":{},"前":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"将":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"文":{"docs":{},"件":{"docs":{},"打":{"docs":{},"包":{"docs":{},"成":{"docs":{},"z":{"docs":{},"i":{"docs":{},"p":{"docs":{},"格":{"docs":{},"式":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"侧":{"docs":{},"边":{"docs":{},"栏":{"docs":{},"点":{"docs":{},"击":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"添":{"docs":{},"加":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}},"检":{"docs":{},"查":{"docs":{},"完":{"docs":{},"目":{"docs":{},"标":{"docs":{},"网":{"docs":{},"页":{"docs":{},"的":{"docs":{},"元":{"docs":{},"素":{"docs":{},"c":{"docs":{},"s":{"docs":{},"s":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"输":{"docs":{},"入":{"docs":{},"列":{"docs":{},"表":{"docs":{},"项":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{},"、":{"docs":{},"开":{"docs":{},"始":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"、":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},"/":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"等":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{},"注":{"docs":{},"意":{"docs":{},"勾":{"docs":{},"选":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"为":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},"点":{"docs":{},"击":{"docs":{},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"的":{"docs":{},"部":{"docs":{},"署":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"将":{"docs":{},"指":{"docs":{},"定":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"所":{"docs":{},"有":{"docs":{},"在":{"docs":{},"线":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},";":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}},"部":{"docs":{},"署":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"将":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"所":{"docs":{},"有":{"docs":{},"在":{"docs":{},"线":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},";":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"点":{"docs":{},"击":{"docs":{},"运":{"docs":{},"行":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"或":{"docs":{},"者":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}},"详":{"docs":{},"情":{"docs":{},"的":{"docs":{},"概":{"docs":{},"览":{"docs":{},"标":{"docs":{},"签":{"docs":{},"中":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"部":{"docs":{},"署":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"将":{"docs":{},"指":{"docs":{},"定":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"所":{"docs":{},"有":{"docs":{},"在":{"docs":{},"线":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},"。":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"中":{"docs":{},"概":{"docs":{},"览":{"docs":{},"标":{"docs":{},"签":{"docs":{},"下":{"docs":{},"点":{"docs":{},"击":{"docs":{},"运":{"docs":{},"行":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"或":{"docs":{},"者":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}},"运":{"docs":{},"行":{"docs":{},"了":{"docs":{},"一":{"docs":{},"段":{"docs":{},"时":{"docs":{},"间":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"会":{"docs":{},"积":{"docs":{},"累":{"docs":{},"一":{"docs":{},"些":{"docs":{},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"运":{"docs":{},"行":{"docs":{},"成":{"docs":{},"功":{"docs":{},"率":{"docs":{},"、":{"docs":{},"任":{"docs":{},"务":{"docs":{},"数":{"docs":{},"、":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"长":{"docs":{},"等":{"docs":{},"指":{"docs":{},"标":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"将":{"docs":{},"这":{"docs":{},"些":{"docs":{},"指":{"docs":{},"标":{"docs":{},"汇":{"docs":{},"总":{"docs":{},"并":{"docs":{},"呈":{"docs":{},"现":{"docs":{},"给":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"。":{"docs":{"Usage/Spider/Analytics.html":{"ref":"Usage/Spider/Analytics.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"创":{"docs":{},"建":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":10.2}}}}}},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2},"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":10.03225806451613}},"是":{"docs":{},"版":{"docs":{},"本":{"docs":{},"v":{"0":{"docs":{},".":{"2":{"docs":{},".":{"1":{"docs":{},"开":{"docs":{},"发":{"docs":{},"的":{"docs":{},"功":{"docs":{},"能":{"docs":{},"。":{"docs":{},"目":{"docs":{},"的":{"docs":{},"是":{"docs":{},"将":{"docs":{},"具":{"docs":{},"有":{"docs":{},"相":{"docs":{},"似":{"docs":{},"网":{"docs":{},"站":{"docs":{},"结":{"docs":{},"构":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"化":{"docs":{},",":{"docs":{},"将":{"docs":{},"开":{"docs":{},"发":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"过":{"docs":{},"程":{"docs":{},"流":{"docs":{},"程":{"docs":{},"化":{"docs":{},",":{"docs":{},"大":{"docs":{},"大":{"docs":{},"提":{"docs":{},"高":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"开":{"docs":{},"发":{"docs":{},"效":{"docs":{},"率":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}},"docs":{}}},"docs":{}}}}}}}}}},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Analytics.html":{"ref":"Usage/Spider/Analytics.html","tf":10.333333333333334}}}}}},"部":{"docs":{},"署":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":10.142857142857142}},"很":{"docs":{},"简":{"docs":{},"单":{"docs":{},",":{"docs":{},"有":{"docs":{},"三":{"docs":{},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}},"好":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"运":{"docs":{},"行":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2},"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":10.066666666666666}},"是":{"docs":{},"指":{"docs":{},"用":{"docs":{},"户":{"docs":{},"可":{"docs":{},"以":{"docs":{},"添":{"docs":{},"加":{"docs":{},"的":{"docs":{},"任":{"docs":{},"何":{"docs":{},"语":{"docs":{},"言":{"docs":{},"任":{"docs":{},"何":{"docs":{},"框":{"docs":{},"架":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"高":{"docs":{},"度":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"化":{"docs":{},"。":{"docs":{},"当":{"docs":{},"用":{"docs":{},"户":{"docs":{},"添":{"docs":{},"加":{"docs":{},"好":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"将":{"docs":{},"其":{"docs":{},"集":{"docs":{},"成":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"的":{"docs":{},"系":{"docs":{},"统":{"docs":{},"中":{"docs":{},"来":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"的":{"docs":{},"添":{"docs":{},"加":{"docs":{},"有":{"docs":{},"两":{"docs":{},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}},"接":{"docs":{},"下":{"docs":{},"来":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"部":{"docs":{},"署":{"docs":{},"、":{"docs":{},"运":{"docs":{},"行":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"上":{"docs":{},"传":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}},"创":{"docs":{},"建":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}},"添":{"docs":{},"加":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}},"&":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.06451612903225806}}},"仅":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},"。":{"docs":{},"这":{"docs":{},"也":{"docs":{},"是":{"docs":{},"最":{"docs":{},"简":{"docs":{},"单":{"docs":{},"的":{"docs":{},"形":{"docs":{},"式":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"列":{"docs":{},"表":{"docs":{},"上":{"docs":{},"的":{"docs":{},"列":{"docs":{},"表":{"docs":{},"项":{"docs":{},",":{"docs":{},"将":{"docs":{},"数":{"docs":{},"据":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"下":{"docs":{},"来":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"只":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}},"列":{"docs":{},"表":{"docs":{},"+":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"先":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},",":{"docs":{},"将":{"docs":{},"列":{"docs":{},"表":{"docs":{},"项":{"docs":{},"中":{"docs":{},"的":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"地":{"docs":{},"址":{"docs":{},"提":{"docs":{},"取":{"docs":{},"出":{"docs":{},"来":{"docs":{},"并":{"docs":{},"跟":{"docs":{},"进":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"页":{"docs":{},"字":{"docs":{},"段":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}},"项":{"docs":{},"的":{"docs":{},"匹":{"docs":{},"和":{"docs":{},"分":{"docs":{},"页":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"的":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"查":{"docs":{},"询":{"docs":{},",":{"docs":{},"由":{"docs":{},"c":{"docs":{},"s":{"docs":{},"s":{"docs":{},"或":{"docs":{},"x":{"docs":{},"p":{"docs":{},"a":{"docs":{},"t":{"docs":{},"h":{"docs":{},"来":{"docs":{},"进":{"docs":{},"行":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}},"开":{"docs":{},"始":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}},"抓":{"docs":{},"取":{"docs":{},"类":{"docs":{},"别":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"字":{"docs":{},"段":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}},"输":{"docs":{},"入":{"docs":{},"完":{"docs":{},"基":{"docs":{},"本":{"docs":{},"信":{"docs":{},"息":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"添":{"docs":{},"加":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}},"遵":{"docs":{},"守":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},"协":{"docs":{},"议":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}},"手":{"docs":{},"动":{"docs":{},"触":{"docs":{},"发":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.18181818181818182}}}}}},"要":{"docs":{},"查":{"docs":{},"看":{"docs":{},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{},"的":{"docs":{},"话":{"docs":{},",":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"在":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"中":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"分":{"docs":{},"析":{"docs":{},"标":{"docs":{},"签":{"docs":{},",":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/Analytics.html":{"ref":"Usage/Spider/Analytics.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"网":{"docs":{},"站":{"docs":{"Usage/Site/":{"ref":"Usage/Site/","tf":10}}}},"架":{"docs":{},"构":{"docs":{"Architecture/":{"ref":"Architecture/","tf":11}}}},"样":{"docs":{},"例":{"docs":{"Examples/":{"ref":"Examples/","tf":10}}}}},"length":285},"corpusTokens":["\"27017:27017\"","\"6379:6379\"","\"8000:8000\"","\"8001:8000\"","\"8002:8000\"","\"8080:8080\"","\"registri","#","&","'3.3'","../crawlab","../frontend","/bin/sh","/home/yeqing/.env.production.master:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production:/opt/crawlab/frontend/.env.product","/home/yeqing/config.master.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/jenkins_home/workspace/crawlab_develop/frontend/dist;","/opt/crawlab/docker_init.sh","16.04是以下命令。","27017:27017","30秒的时间来build前端静态文件,之后就可以打开crawlab界面地址地址看到界面了。界面地址默认为http://localhost:8080。","8000:8000","8080:8080","8080;","[\"https://registry.dock","[app]","\\","alway","api服务","app","app.pi","apt","build:prod","cd","celeri","clone","cn.com\"]","compos","compose.yml后,只需要运行以下命令就可以启动crawlab。","compose.yml定义如下。","compose.yml更改为如下内容。","compose.yml的yaml文件来定义需要启动的容器,可以是单个,也可以(通常)是多个的。crawlab的dock","compose也很简单,大家去网上百度一下就可以了。","compose和定义好dock","compose是一个集群管理方式,可以利用名为dock","compose的方式很适合多节点部署,在原有的master基础上增加几个worker节点,达到多节点部署的目的。将dock","compose的方式来部署。dock","container_name:","crawlab","crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。","crawlab会自动发现project_source_file_folder目录下的所有爬虫目录,并将这些目录生成自定义爬虫并集成到crawlab中。因此,将爬虫项目目录拷贝到project_source_file_folder目录下,就可以添加一个爬虫了。","crawlab允许用户创建两种爬虫:","crawlab是基于celery的分布式爬虫管理平台,可以集成任何语言和任何框架。","crawlab的可配置爬虫是基于scrapy的,因此天生支持并发。而且,可配置爬虫完全支持自定义爬虫的一般功能,因此也支持任务调度、任务监控、日志监控、数据分析。","crawlab简介","d","demo","depends_on:","dev.crawlab.com;","docker","docker安装部署","entrypoint:","exampl","flower","flower.pi","frontend","g","git","https://github.com/tikazyq/crawlab","image:","index","index.html;","instal","listen","log","manage.pi","master","master:","mirrors\":","mongo","mongo:","mongo:latest","mongo一行命令。如何安装docker跟操作系统有关,这里就不展开讲了,需要的同学自行百度一下相关教程。","name","nginx","npm","p","pip","pm2","ports:","pull","python","r","redi","redis:","redis:latest","reload","requir","restart:","rm","root","run","serv","server","server_nam","serve来进行的,因此是开发者模式。注意:强烈不建议在生产环境中用预览模式。预览模式只是让开发者快速体验crawlab以及调试代码问题的一种方式,而不是用作生产环境部署的。","services:","start","sudo","tikazyq/crawlab","tikazyq/crawlab:latest","up","v","version:","volumns:","worker","worker.pi","worker1:","worker2:","worker,他们通过连接到配置好的broker(通常是redis)来进行与主机的通信。","yarn","{","}","下载镜像","仅列表页。这也是最简单的形式,爬虫遍历列表上的列表项,将数据抓取下来。","仅详情页。爬虫只抓取详情页。","任务","使用crawlab","修改节点信息","其中,root是静态文件的根目录,这里是npm打包好后的静态文件。","其中,我们映射了8080端口(nginx前端静态文件)以及8000端口(后端api)到宿主机。另外还将前端配置文件/home/yeqing/.env.production和后端配置文件/home/yeqing/config.py映射到了容器相应的目录下。传入参数master是代表该启动方式为主机启动模式,也就是所有服务(前端、api、flower、worker)都会启动。另外一个模式是worker模式,只会启动必要的api和worker服务,这个对于分布式部署比较有用。等待大约20","分别配置前端配置文件./frontend/.env.production和后端配置文件./crawlab/config/config.py。分别需要对部署后api地址以及数据库地址进行配置。","分页选择器","列表+详情页。爬虫先遍历列表页,将列表项中的详情页地址提取出来并跟进抓取详情页。","列表页字段","列表项的匹和分页按钮的匹配查询,由css或xpath来进行匹配。","列表项选择器","创建爬虫","前端配置文件","前者可以通过web界面和创建项目目录的方式来添加,后者由于没有源代码,只能通过web界面来添加。","可配置爬虫","可配置爬虫是版本v0.2.1开发的功能。目的是将具有相似网站结构的爬虫项目可配置化,将开发爬虫的过程流程化,大大提高爬虫开发效率。","同样,在浏览器中输入http://localhost:8080就可以看到界面。","后端配置文件","后面我们需要让爬虫运行在各个节点上,需要让主机与节点进行通信,因此需要知道节点的ip地址和端口。我们需要手动配置一下节点的ip和端口。在节点列表中点击操作列里的蓝色查看按钮进入到节点详情。节点详情样子如下。","启动服务","在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮。","在右侧分别输入该节点对应的节点ip和节点端口,然后点击保存按钮,保存该节点信息。","在定义爬虫中,我们需要配置一下执行命令(运行爬虫时后台执行的shell命令)和结果集(通过crawlab_collection传递给爬虫程序,爬虫程序存储结果的地方),然后点击保存按钮保存爬虫信息。","在检查完目标网页的元素css选择器之后,我们输入列表项选择器、开始url、列表页/详情页等信息。注意勾选url为详情页url。","在爬虫列表中操作列点击运行按钮,或者","在爬虫列表中点击操作列的部署按钮,将指定爬虫部署到所有在线节点中;","在爬虫列表中点击部署所有爬虫,将所有爬虫部署到所有在线节点中;","在爬虫详情中概览标签下点击运行按钮,或者","在爬虫详情的概览标签中,点击部署按钮,将指定爬虫部署到所有在线节点中。","在运行了一段时间之后,爬虫会积累一些统计数据,例如运行成功率、任务数、运行时长等指标。crawlab将这些指标汇总并呈现给开发者。","在通过web界面上传之前,需要将爬虫项目文件打包成zip格式。","基于celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.","多节点模式","安装","安装crawlab","安装docker","安装nginx,在ubuntu","安装前端所需库。","安装后端所需库。","安装完docker","定时任务","定时任务触发","定时任务触发是比较常用的功能,对于增量抓取或对实时性有要求的任务很重要。这在定时任务中会详细介绍。","对docker不了解的开发者,可以参考一下这篇文章(9102","对于自定义爬虫,可以在配置标签下点击运行按钮","年了,学点","开始url","当然,也可以用docker","我们已经在dockerhub上构建了crawlab的镜像,开发者只需要将其pull下来使用。在pul","我们有两种运行爬虫的方式:","手动触发","执行以下命令将crawlab的镜像下载下来。镜像大小大概在几百兆,因此下载需要几分钟时间。","抓取类别","拉取代码","拷贝一份后端配置文件./crawlab/config/config.py以及前端配置文件./frontend/.env.production到某一个地方。例如我的例子,分别为/home/yeqing/config.py和/home/yeqing/.env.production。","接下来,我们就可以部署、运行自定义爬虫了。","更改后端配置文件config.py,将mongodb、redis的指向ip更改为自己数据的值。注意,容器中对应的宿主机的ip地址不是localhost,而是172.17.0.1(当然也可以用network来做,只是稍微麻烦一些)。更改前端配置文件.env.production,将api地址vue_app_base_url更改为宿主机所在的ip地址,例如http://192.168.0.8:8000,这将是前端调用api会用到的url。","更改好配置文件之后,接下来就是运行容器了。执行以下命令来启动容器。","更改配置文件","本使用手册会帮助您解决在安装使用crawlab遇到的任何问题。","本小节将介绍三种安装docker的方式:","本小节将介绍如何使用crawlab,包括如下内容:","构建","构建完成后,会在./frontend目录下创建一个dist文件夹,里面是打包好后的静态文件。","架构","查看演示","查看节点","查看节点列表","样例","添加/etc/nginx/conf.d/crawlab.conf文件,输入以下内容。","添加完成后,可以看到刚刚添加的可配置爬虫出现了在最下方,点击查看进入到爬虫详情。","添加爬虫","点击侧边栏的节点导航至节点列表,可以看到已上线的节点。这里的节点其实就是已经运行起来的celeri","点击保存、预览,查看预览内容。","点击可配置爬虫。","点击配置标签进入到配置页面。接下来,我们需要对爬虫规则进行配置。","然后在浏览器中输入http://localhost:8080就可以看到界面了。","然后,crawlab会提示任务已经派发到队列中去了,然后你可以在爬虫详情左侧看到新创建的任务。点击创建时间可以导航至任务详情。","然后,在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮,选择自定义爬虫,点击上传按钮,选择刚刚打包好的zip文件。上传成功后,爬虫列表中会出现新添加的自定义爬虫。这样就算添加好了。","爬虫","爬虫就是我们通常说的网络爬虫了,本小节将介绍如下内容:","爬虫最开始遍历的网址。","现在,只需要启动nginx服务就完成了启动前端服务。","直接部署","直接部署是之前没有docker时的部署方式,相对于docker部署来说有些繁琐。但了解如何直接部署可以帮助更深入地理解docker是如何构建crawlab镜像的。这里简单介绍一下。","知识)做进一步了解。简单来说,docker可以利用已存在的镜像帮助构建一些常用的服务和应用,例如nginx、mongodb、redis等等。用docker运行一个mongodb服务仅需dock","统计数据","网站","自定义爬虫","自定义爬虫是指用户可以添加的任何语言任何框架的爬虫,高度自定义化。当用户添加好自定义爬虫之后,crawlab就可以将其集成到爬虫管理的系统中来。","自定义爬虫的添加有两种方式:","节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口(默认为localhost:8000)。","要查看统计数据的话,只需要在爬虫详情中,点击分析标签,就可以看到爬虫的统计数据了。","该模式同样会启动3个后端服务和1个前端服务。前端服务是通过npm","详情页字段","输入完基本信息,点击添加。","运行docker容器","运行爬虫","这个方式稍微有些繁琐,但是对于无法轻松获取服务器的读写权限时是非常有用的,适合在生产环境上使用。","这个默认是开启的。如果开启,爬虫将先抓取网站的robots.txt并判断页面是否可抓;否则,不会对此进行验证。用户可以选择将其关闭。请注意,任何无视robots协议的行为都有法律风险。","这也是爬虫抓取采用的策略,也就是爬虫遍历网页是如何进行的。作为第一个版本,我们有仅列表、仅详情页、列表+详情页。","这些都是再列表页或详情页中需要提取的字段。字段由css选择器或者xpath来匹配提取。可以选择文本或者属性。","这应该是部署应用的最方便也是最节省时间的方式了。在最近的一次版本更新v0.2.3中,我们发布了docker功能,让大家可以利用docker来轻松部署crawlab。下面将一步一步介绍如何使用docker来部署crawlab。","这样的话,pull镜像的速度会比不改变镜像源的速度快很多。","这样,pm2会启动3个守护进程来管理这3个服务。我们如果想看后端服务的日志的话,可以执行以下命令。","这样,我们就完成了节点的配置工作。","这种方式非常方便,但是需要获得主机服务器的读写权限,因而比较适合在开发环境上采用。","这里先定义了master节点,也就是crawlab的主节点。master依赖于mongo和redis容器,因此在启动之前会同时启动mongo和redis容器。这样就不需要单独配置mongo和redis服务了,大大节省了环境配置的时间。","这里启动了多增加了两个worker节点,以worker模式启动。这样,多节点部署,也就是分布式部署就完成了。","这里已经有一些配置好的初始输入项。我们简单介绍一下各自的含义。","这里我们选择列表+详情页。","这里是指启动后端服务。我们用pm2来管理进程。执行以下命令。","这里的构建是指前端构建,需要执行以下命令。","这里的爬虫部署是指自定义爬虫的部署,因为可配置爬虫已经内嵌到crawlab中了,所有节点都可以使用,不需要额外部署。简单来说,就是将主机上的爬虫源代码通过http的方式打包传输至worker节点上,因此节点就可以运行传输过来的爬虫了。","通过web界面上传","通过web界面上传爬虫","通过创建项目目录","通过添加项目目录","遵守robots协议","部署好之后,我们就可以运行爬虫了。","部署爬虫","部署爬虫很简单,有三种方式:","配置","配置爬虫","镜像之前,我们需要配置一下镜像源。因为我们在墙内,使用原有的镜像源速度非常感人,因此将使用dockerhub在国内的加速器。创建/etc/docker/daemon.json文件,在其中输入如下内容。","项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。","预览模式","预览模式是一种让用户比较快的上手的一种部署模式。跟直接部署类似,但不用经过构建、nginx和启动服务的步骤。在启动时只需要执行以下命令就可以了。相较于直接部署来说方便一些。","首先是将github上的代码拉取到本地。","首先,我们来看如何安装crawlab吧,请查看安装。"],"pipeline":["stopWordFilter","stemmer"]},"store":{"./":{"url":"./","title":"Crawlab简介","keywords":"","body":"Crawlab\n基于Celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.\n查看演示 Demo\nCrawlab是基于Celery的分布式爬虫管理平台,可以集成任何语言和任何框架。\n项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用Crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将Crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。\nCrawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。Crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。\n本使用手册会帮助您解决在安装使用Crawlab遇到的任何问题。\n首先,我们来看如何安装Crawlab吧,请查看安装。\n"},"Installation/":{"url":"Installation/","title":"安装Crawlab","keywords":"","body":"本小节将介绍三种安装Docker的方式:\n\nDocker\n直接部署\n预览模式\n\n"},"Installation/Docker.html":{"url":"Installation/Docker.html","title":"Docker","keywords":"","body":"Docker安装部署\n这应该是部署应用的最方便也是最节省时间的方式了。在最近的一次版本更新v0.2.3中,我们发布了Docker功能,让大家可以利用Docker来轻松部署Crawlab。下面将一步一步介绍如何使用Docker来部署Crawlab。\n对Docker不了解的开发者,可以参考一下这篇文章(9102 年了,学点 Docker 知识)做进一步了解。简单来说,Docker可以利用已存在的镜像帮助构建一些常用的服务和应用,例如Nginx、MongoDB、Redis等等。用Docker运行一个MongoDB服务仅需docker run -d --name mongo -p 27017:27017 mongo一行命令。如何安装Docker跟操作系统有关,这里就不展开讲了,需要的同学自行百度一下相关教程。\n下载镜像\n我们已经在DockerHub上构建了Crawlab的镜像,开发者只需要将其pull下来使用。在pull 镜像之前,我们需要配置一下镜像源。因为我们在墙内,使用原有的镜像源速度非常感人,因此将使用DockerHub在国内的加速器。创建/etc/docker/daemon.json文件,在其中输入如下内容。\n{\n \"registry-mirrors\": [\"https://registry.docker-cn.com\"]\n}\n\n这样的话,pull镜像的速度会比不改变镜像源的速度快很多。\n执行以下命令将Crawlab的镜像下载下来。镜像大小大概在几百兆,因此下载需要几分钟时间。\ndocker pull tikazyq/crawlab:latest\n\n更改配置文件\n拷贝一份后端配置文件./crawlab/config/config.py以及前端配置文件./frontend/.env.production到某一个地方。例如我的例子,分别为/home/yeqing/config.py和/home/yeqing/.env.production。\n更改后端配置文件config.py,将MongoDB、Redis的指向IP更改为自己数据的值。注意,容器中对应的宿主机的IP地址不是localhost,而是172.17.0.1(当然也可以用network来做,只是稍微麻烦一些)。更改前端配置文件.env.production,将API地址VUE_APP_BASE_URL更改为宿主机所在的IP地址,例如http://192.168.0.8:8000,这将是前端调用API会用到的URL。\n运行Docker容器\n更改好配置文件之后,接下来就是运行容器了。执行以下命令来启动容器。\ndocker run -d --rm --name crawlab \\\n -p 8080:8080 \\\n -p 8000:8000 \\\n -v /home/yeqing/.env.production:/opt/crawlab/frontend/.env.production \\\n -v /home/yeqing/config.py:/opt/crawlab/crawlab/config/config.py \\\n tikazyq/crawlab master\n\n其中,我们映射了8080端口(Nginx前端静态文件)以及8000端口(后端API)到宿主机。另外还将前端配置文件/home/yeqing/.env.production和后端配置文件/home/yeqing/config.py映射到了容器相应的目录下。传入参数master是代表该启动方式为主机启动模式,也就是所有服务(前端、Api、Flower、Worker)都会启动。另外一个模式是worker模式,只会启动必要的Api和Worker服务,这个对于分布式部署比较有用。等待大约20-30秒的时间来build前端静态文件,之后就可以打开Crawlab界面地址地址看到界面了。界面地址默认为http://localhost:8080。\n\nDocker-Compose\n当然,也可以用docker-compose的方式来部署。docker-compose是一个集群管理方式,可以利用名为docker-compose.yml的yaml文件来定义需要启动的容器,可以是单个,也可以(通常)是多个的。Crawlab的docker-compose.yml定义如下。\nversion: '3.3'\nservices:\n master: \n image: tikazyq/crawlab:latest\n container_name: crawlab\n volumns:\n - /home/yeqing/config.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports: \n - \"8080:8080\" # nginx\n - \"8000:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - master\n mongo:\n image: mongo:latest\n restart: always\n ports:\n - \"27017:27017\"\n redis:\n image: redis:latest\n restart: always\n ports:\n - \"6379:6379\"\n\n这里先定义了master节点,也就是Crawlab的主节点。master依赖于mongo和redis容器,因此在启动之前会同时启动mongo和redis容器。这样就不需要单独配置mongo和redis服务了,大大节省了环境配置的时间。\n安装docker-compose也很简单,大家去网上百度一下就可以了。\n安装完docker-compose和定义好docker-compose.yml后,只需要运行以下命令就可以启动Crawlab。\ndocker-compose up\n\n同样,在浏览器中输入http://localhost:8080就可以看到界面。\n多节点模式\ndocker-compose的方式很适合多节点部署,在原有的master基础上增加几个worker节点,达到多节点部署的目的。将docker-compose.yml更改为如下内容。\nversion: '3.3'\nservices:\n master: \n image: tikazyq/crawlab:latest\n container_name: crawlab\n volumns:\n - /home/yeqing/config.master.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production.master:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports: \n - \"8080:8080\" # nginx\n - \"8000:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - master\n worker1: \n image: tikazyq/crawlab:latest\n volumns:\n - /home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports:\n - \"8001:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - worker\n worker2: \n image: tikazyq/crawlab:latest\n volumns:\n - /home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports:\n - \"8002:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - worker\n mongo:\n image: mongo:latest\n restart: always\n ports:\n - \"27017:27017\"\n redis:\n image: redis:latest\n restart: always\n ports:\n - \"6379:6379\"\n\n这里启动了多增加了两个worker节点,以worker模式启动。这样,多节点部署,也就是分布式部署就完成了。\n"},"Installation/Direct.html":{"url":"Installation/Direct.html","title":"直接部署","keywords":"","body":"直接部署\n直接部署是之前没有Docker时的部署方式,相对于Docker部署来说有些繁琐。但了解如何直接部署可以帮助更深入地理解Docker是如何构建Crawlab镜像的。这里简单介绍一下。\n拉取代码\n首先是将github上的代码拉取到本地。\ngit clone https://github.com/tikazyq/crawlab\n\n安装\n安装前端所需库。\nnpm install -g yarn pm2\ncd frontend\nyarn install\n\n安装后端所需库。\ncd ../crawlab\npip install -r requirements\n\n配置\n分别配置前端配置文件./frontend/.env.production和后端配置文件./crawlab/config/config.py。分别需要对部署后API地址以及数据库地址进行配置。\n构建\n这里的构建是指前端构建,需要执行以下命令。\ncd ../frontend\nnpm run build:prod\n\n构建完成后,会在./frontend目录下创建一个dist文件夹,里面是打包好后的静态文件。\nNginx\n安装nginx,在ubuntu 16.04是以下命令。\nsudo apt-get install nginx\n\n添加/etc/nginx/conf.d/crawlab.conf文件,输入以下内容。\nserver {\n listen 8080;\n server_name dev.crawlab.com;\n root /home/yeqing/jenkins_home/workspace/crawlab_develop/frontend/dist;\n index index.html;\n}\n其中,root是静态文件的根目录,这里是npm打包好后的静态文件。\n现在,只需要启动nginx服务就完成了启动前端服务。\nnginx reload\n\n启动服务\n这里是指启动后端服务。我们用pm2来管理进程。执行以下命令。\npm2 start app.py # API服务\npm2 start worker.py # Worker\npm2 start flower.py # Flower\n\n这样,pm2会启动3个守护进程来管理这3个服务。我们如果想看后端服务的日志的话,可以执行以下命令。\npm2 logs [app]\n\n然后在浏览器中输入http://localhost:8080就可以看到界面了。\n"},"Installation/Preview.html":{"url":"Installation/Preview.html","title":"预览模式","keywords":"","body":"预览模式\n预览模式是一种让用户比较快的上手的一种部署模式。跟直接部署类似,但不用经过构建、nginx和启动服务的步骤。在启动时只需要执行以下命令就可以了。相较于直接部署来说方便一些。\npython manage.py serve\n\n该模式同样会启动3个后端服务和1个前端服务。前端服务是通过npm run serve来进行的,因此是开发者模式。注意:强烈不建议在生产环境中用预览模式。预览模式只是让开发者快速体验Crawlab以及调试代码问题的一种方式,而不是用作生产环境部署的。\n"},"Usage/":{"url":"Usage/","title":"使用Crawlab","keywords":"","body":"本小节将介绍如何使用Crawlab,包括如下内容:\n\n节点\n爬虫\n任务\n定时任务\n\n"},"Usage/Node/":{"url":"Usage/Node/","title":"节点","keywords":"","body":"节点\n节点其实就是Celery中的Worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口(默认为localhost:8000)。\n\n查看节点\n修改节点信息\n\n"},"Usage/Node/View.html":{"url":"Usage/Node/View.html","title":"查看节点列表","keywords":"","body":"查看节点列表\n点击侧边栏的节点导航至节点列表,可以看到已上线的节点。这里的节点其实就是已经运行起来的celery worker,他们通过连接到配置好的broker(通常是redis)来进行与主机的通信。\n\n"},"Usage/Node/Edit.html":{"url":"Usage/Node/Edit.html","title":"修改节点信息","keywords":"","body":"修改节点信息\n后面我们需要让爬虫运行在各个节点上,需要让主机与节点进行通信,因此需要知道节点的IP地址和端口。我们需要手动配置一下节点的IP和端口。在节点列表中点击操作列里的蓝色查看按钮进入到节点详情。节点详情样子如下。\n\n在右侧分别输入该节点对应的节点IP和节点端口,然后点击保存按钮,保存该节点信息。\n这样,我们就完成了节点的配置工作。\n"},"Usage/Spider/":{"url":"Usage/Spider/","title":"爬虫","keywords":"","body":"爬虫\n爬虫就是我们通常说的网络爬虫了,本小节将介绍如下内容:\n\n创建爬虫\n部署爬虫\n运行爬虫\n可配置爬虫\n统计数据\n\n"},"Usage/Spider/Create.html":{"url":"Usage/Spider/Create.html","title":"创建爬虫","keywords":"","body":"创建爬虫\nCrawlab允许用户创建两种爬虫:\n\n自定义爬虫\n可配置爬虫\n\n前者可以通过Web界面和创建项目目录的方式来添加,后者由于没有源代码,只能通过Web界面来添加。\n"},"Usage/Spider/CustomizedSpider.html":{"url":"Usage/Spider/CustomizedSpider.html","title":"自定义爬虫","keywords":"","body":"自定义爬虫\n自定义爬虫是指用户可以添加的任何语言任何框架的爬虫,高度自定义化。当用户添加好自定义爬虫之后,Crawlab就可以将其集成到爬虫管理的系统中来。\n自定义爬虫的添加有两种方式:\n\n通过Web界面上传爬虫\n通过创建项目目录\n\n通过Web界面上传\n在通过Web界面上传之前,需要将爬虫项目文件打包成zip格式。\n\n然后,在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮,选择自定义爬虫,点击上传按钮,选择刚刚打包好的zip文件。上传成功后,爬虫列表中会出现新添加的自定义爬虫。这样就算添加好了。\n这个方式稍微有些繁琐,但是对于无法轻松获取服务器的读写权限时是非常有用的,适合在生产环境上使用。\n通过添加项目目录\nCrawlab会自动发现PROJECT_SOURCE_FILE_FOLDER目录下的所有爬虫目录,并将这些目录生成自定义爬虫并集成到Crawlab中。因此,将爬虫项目目录拷贝到PROJECT_SOURCE_FILE_FOLDER目录下,就可以添加一个爬虫了。\n这种方式非常方便,但是需要获得主机服务器的读写权限,因而比较适合在开发环境上采用。\n配置爬虫\n在定义爬虫中,我们需要配置一下执行命令(运行爬虫时后台执行的shell命令)和结果集(通过CRAWLAB_COLLECTION传递给爬虫程序,爬虫程序存储结果的地方),然后点击保存按钮保存爬虫信息。\n\n接下来,我们就可以部署、运行自定义爬虫了。\n"},"Usage/Spider/ConfigurableSpider.html":{"url":"Usage/Spider/ConfigurableSpider.html","title":"可配置爬虫","keywords":"","body":"可配置爬虫\n可配置爬虫是版本v0.2.1开发的功能。目的是将具有相似网站结构的爬虫项目可配置化,将开发爬虫的过程流程化,大大提高爬虫开发效率。\nCrawlab的可配置爬虫是基于Scrapy的,因此天生支持并发。而且,可配置爬虫完全支持自定义爬虫的一般功能,因此也支持任务调度、任务监控、日志监控、数据分析。\n添加爬虫\n在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮。\n\n点击可配置爬虫。\n\n输入完基本信息,点击添加。\n\n配置爬虫\n添加完成后,可以看到刚刚添加的可配置爬虫出现了在最下方,点击查看进入到爬虫详情。\n\n点击配置标签进入到配置页面。接下来,我们需要对爬虫规则进行配置。\n\n这里已经有一些配置好的初始输入项。我们简单介绍一下各自的含义。\n抓取类别\n这也是爬虫抓取采用的策略,也就是爬虫遍历网页是如何进行的。作为第一个版本,我们有仅列表、仅详情页、列表+详情页。\n\n仅列表页。这也是最简单的形式,爬虫遍历列表上的列表项,将数据抓取下来。\n仅详情页。爬虫只抓取详情页。\n列表+详情页。爬虫先遍历列表页,将列表项中的详情页地址提取出来并跟进抓取详情页。\n\n这里我们选择列表+详情页。\n列表项选择器 & 分页选择器\n列表项的匹和分页按钮的匹配查询,由CSS或XPath来进行匹配。\n开始URL\n爬虫最开始遍历的网址。\n遵守Robots协议\n这个默认是开启的。如果开启,爬虫将先抓取网站的robots.txt并判断页面是否可抓;否则,不会对此进行验证。用户可以选择将其关闭。请注意,任何无视Robots协议的行为都有法律风险。\n列表页字段 & 详情页字段\n这些都是再列表页或详情页中需要提取的字段。字段由CSS选择器或者XPath来匹配提取。可以选择文本或者属性。\n在检查完目标网页的元素CSS选择器之后,我们输入列表项选择器、开始URL、列表页/详情页等信息。注意勾选url为详情页URL。\n\n点击保存、预览,查看预览内容。\n\n"},"Usage/Spider/Deploy.html":{"url":"Usage/Spider/Deploy.html","title":"部署爬虫","keywords":"","body":"部署爬虫\n这里的爬虫部署是指自定义爬虫的部署,因为可配置爬虫已经内嵌到Crawlab中了,所有节点都可以使用,不需要额外部署。简单来说,就是将主机上的爬虫源代码通过HTTP的方式打包传输至worker节点上,因此节点就可以运行传输过来的爬虫了。\n部署爬虫很简单,有三种方式:\n\n在爬虫列表中点击部署所有爬虫,将所有爬虫部署到所有在线节点中;\n在爬虫列表中点击操作列的部署按钮,将指定爬虫部署到所有在线节点中;\n在爬虫详情的概览标签中,点击部署按钮,将指定爬虫部署到所有在线节点中。\n\n部署好之后,我们就可以运行爬虫了。\n"},"Usage/Spider/Run.html":{"url":"Usage/Spider/Run.html","title":"运行爬虫","keywords":"","body":"运行爬虫\n我们有两种运行爬虫的方式:\n\n手动触发\n定时任务触发\n\n手动触发\n\n在爬虫列表中操作列点击运行按钮,或者\n在爬虫详情中概览标签下点击运行按钮,或者\n对于自定义爬虫,可以在配置标签下点击运行按钮\n\n然后,Crawlab会提示任务已经派发到队列中去了,然后你可以在爬虫详情左侧看到新创建的任务。点击创建时间可以导航至任务详情。\n定时任务触发\n定时任务触发是比较常用的功能,对于增量抓取或对实时性有要求的任务很重要。这在定时任务中会详细介绍。\n"},"Usage/Spider/Analytics.html":{"url":"Usage/Spider/Analytics.html","title":"统计数据","keywords":"","body":"统计数据\n在运行了一段时间之后,爬虫会积累一些统计数据,例如运行成功率、任务数、运行时长等指标。Crawlab将这些指标汇总并呈现给开发者。\n要查看统计数据的话,只需要在爬虫详情中,点击分析标签,就可以看到爬虫的统计数据了。\n\n"},"Usage/Task/":{"url":"Usage/Task/","title":"任务","keywords":"","body":""},"Usage/Schedule/":{"url":"Usage/Schedule/","title":"定时任务","keywords":"","body":""},"Usage/Site/":{"url":"Usage/Site/","title":"网站","keywords":"","body":""},"Architecture/":{"url":"Architecture/","title":"架构","keywords":"","body":"架构\n"},"Architecture/Celery.html":{"url":"Architecture/Celery.html","title":"Celery","keywords":"","body":"Celery\n"},"Architecture/App.html":{"url":"Architecture/App.html","title":"App","keywords":"","body":"App\n"},"Examples/":{"url":"Examples/","title":"样例","keywords":"","body":"Examples\n"}}} \ No newline at end of file +{"index":{"version":"0.5.12","fields":[{"name":"title","boost":10},{"name":"keywords","boost":15},{"name":"body","boost":1}],"ref":"url","documentStore":{"store":{"./":["crawlab","crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。","crawlab是基于celery的分布式爬虫管理平台,可以集成任何语言和任何框架。","crawlab简介","demo","基于celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.","本使用手册会帮助您解决在安装使用crawlab遇到的任何问题。","查看演示","项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。","首先,我们来看如何安装crawlab吧,请查看安装。"],"Installation/":["docker","安装crawlab","本小节将介绍三种安装docker的方式:","直接部署","预览模式"],"Installation/Docker.html":["\"27017:27017\"","\"6379:6379\"","\"8000:8000\"","\"8001:8000\"","\"8002:8000\"","\"8080:8080\"","\"registri","#","'3.3'","/bin/sh","/home/yeqing/.env.production.master:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production:/opt/crawlab/frontend/.env.product","/home/yeqing/config.master.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.pi","/opt/crawlab/docker_init.sh","27017:27017","30秒的时间来build前端静态文件,之后就可以打开crawlab界面地址地址看到界面了。界面地址默认为http://localhost:8080。","8000:8000","8080:8080","[\"https://registry.dock","\\","alway","app","cn.com\"]","compos","compose.yml后,只需要运行以下命令就可以启动crawlab。","compose.yml定义如下。","compose.yml更改为如下内容。","compose.yml的yaml文件来定义需要启动的容器,可以是单个,也可以(通常)是多个的。crawlab的dock","compose也很简单,大家去网上百度一下就可以了。","compose和定义好dock","compose是一个集群管理方式,可以利用名为dock","compose的方式很适合多节点部署,在原有的master基础上增加几个worker节点,达到多节点部署的目的。将dock","compose的方式来部署。dock","container_name:","crawlab","d","depends_on:","docker","docker安装部署","entrypoint:","image:","master","master:","mirrors\":","mongo","mongo:","mongo:latest","mongo一行命令。如何安装docker跟操作系统有关,这里就不展开讲了,需要的同学自行百度一下相关教程。","name","nginx","p","ports:","pull","redi","redis:","redis:latest","restart:","rm","run","services:","tikazyq/crawlab","tikazyq/crawlab:latest","up","v","version:","volumns:","worker","worker1:","worker2:","{","}","下载镜像","其中,我们映射了8080端口(nginx前端静态文件)以及8000端口(后端api)到宿主机。另外还将前端配置文件/home/yeqing/.env.production和后端配置文件/home/yeqing/config.py映射到了容器相应的目录下。传入参数master是代表该启动方式为主机启动模式,也就是所有服务(前端、api、flower、worker)都会启动。另外一个模式是worker模式,只会启动必要的api和worker服务,这个对于分布式部署比较有用。等待大约20","前端配置文件","同样,在浏览器中输入http://localhost:8080就可以看到界面。","后端配置文件","多节点模式","安装docker","安装完docker","对docker不了解的开发者,可以参考一下这篇文章(9102","年了,学点","当然,也可以用docker","我们已经在dockerhub上构建了crawlab的镜像,开发者只需要将其pull下来使用。在pul","执行以下命令将crawlab的镜像下载下来。镜像大小大概在几百兆,因此下载需要几分钟时间。","拷贝一份后端配置文件./crawlab/config/config.py以及前端配置文件./frontend/.env.production到某一个地方。例如我的例子,分别为/home/yeqing/config.py和/home/yeqing/.env.production。","更改后端配置文件config.py,将mongodb、redis的指向ip更改为自己数据的值。注意,容器中对应的宿主机的ip地址不是localhost,而是172.17.0.1(当然也可以用network来做,只是稍微麻烦一些)。更改前端配置文件.env.production,将api地址vue_app_base_url更改为宿主机所在的ip地址,例如http://192.168.0.8:8000,这将是前端调用api会用到的url。","更改好配置文件之后,接下来就是运行容器了。执行以下命令来启动容器。","更改配置文件","知识)做进一步了解。简单来说,docker可以利用已存在的镜像帮助构建一些常用的服务和应用,例如nginx、mongodb、redis等等。用docker运行一个mongodb服务仅需dock","运行docker容器","这应该是部署应用的最方便也是最节省时间的方式了。在最近的一次版本更新v0.2.3中,我们发布了docker功能,让大家可以利用docker来轻松部署crawlab。下面将一步一步介绍如何使用docker来部署crawlab。","这样的话,pull镜像的速度会比不改变镜像源的速度快很多。","这里先定义了master节点,也就是crawlab的主节点。master依赖于mongo和redis容器,因此在启动之前会同时启动mongo和redis容器。这样就不需要单独配置mongo和redis服务了,大大节省了环境配置的时间。","这里启动了多增加了两个worker节点,以worker模式启动。这样,多节点部署,也就是分布式部署就完成了。","镜像之前,我们需要配置一下镜像源。因为我们在墙内,使用原有的镜像源速度非常感人,因此将使用dockerhub在国内的加速器。创建/etc/docker/daemon.json文件,在其中输入如下内容。"],"Installation/Direct.html":["#","../crawlab","../frontend","/home/yeqing/jenkins_home/workspace/crawlab_develop/frontend/dist;","16.04是以下命令。","8080;","[app]","api服务","app.pi","apt","build:prod","cd","clone","dev.crawlab.com;","flower","flower.pi","frontend","g","git","https://github.com/tikazyq/crawlab","index","index.html;","instal","listen","log","nginx","npm","pip","pm2","r","reload","requir","root","run","server","server_nam","start","sudo","worker","worker.pi","yarn","{","}","其中,root是静态文件的根目录,这里是npm打包好后的静态文件。","分别配置前端配置文件./frontend/.env.production和后端配置文件./crawlab/config/config.py。分别需要对部署后api地址以及数据库地址进行配置。","启动服务","安装","安装nginx,在ubuntu","安装前端所需库。","安装后端所需库。","拉取代码","构建","构建完成后,会在./frontend目录下创建一个dist文件夹,里面是打包好后的静态文件。","添加/etc/nginx/conf.d/crawlab.conf文件,输入以下内容。","然后在浏览器中输入http://localhost:8080就可以看到界面了。","现在,只需要启动nginx服务就完成了启动前端服务。","直接部署","直接部署是之前没有docker时的部署方式,相对于docker部署来说有些繁琐。但了解如何直接部署可以帮助更深入地理解docker是如何构建crawlab镜像的。这里简单介绍一下。","这样,pm2会启动3个守护进程来管理这3个服务。我们如果想看后端服务的日志的话,可以执行以下命令。","这里是指启动后端服务。我们用pm2来管理进程。执行以下命令。","这里的构建是指前端构建,需要执行以下命令。","配置","首先是将github上的代码拉取到本地。"],"Installation/Preview.html":["manage.pi","python","run","serv","serve来进行的,因此是开发者模式。注意:强烈不建议在生产环境中用预览模式。预览模式只是让开发者快速体验crawlab以及调试代码问题的一种方式,而不是用作生产环境部署的。","该模式同样会启动3个后端服务和1个前端服务。前端服务是通过npm","预览模式","预览模式是一种让用户比较快的上手的一种部署模式。跟直接部署类似,但不用经过构建、nginx和启动服务的步骤。在启动时只需要执行以下命令就可以了。相较于直接部署来说方便一些。"],"Usage/":["任务","使用crawlab","定时任务","本小节将介绍如何使用crawlab,包括如下内容:","爬虫","节点"],"Usage/Node/":["修改节点信息","查看节点","节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口(默认为localhost:8000)。"],"Usage/Node/View.html":["worker,他们通过连接到配置好的broker(通常是redis)来进行与主机的通信。","查看节点列表","点击侧边栏的节点导航至节点列表,可以看到已上线的节点。这里的节点其实就是已经运行起来的celeri"],"Usage/Node/Edit.html":["修改节点信息","后面我们需要让爬虫运行在各个节点上,需要让主机与节点进行通信,因此需要知道节点的ip地址和端口。我们需要手动配置一下节点的ip和端口。在节点列表中点击操作列里的蓝色查看按钮进入到节点详情。节点详情样子如下。","在右侧分别输入该节点对应的节点ip和节点端口,然后点击保存按钮,保存该节点信息。","这样,我们就完成了节点的配置工作。"],"Usage/Spider/":["创建爬虫","可配置爬虫","爬虫","爬虫就是我们通常说的网络爬虫了,本小节将介绍如下内容:","统计数据","运行爬虫","部署爬虫"],"Usage/Spider/Create.html":["crawlab允许用户创建两种爬虫:","创建爬虫","前者可以通过web界面和创建项目目录的方式来添加,后者由于没有源代码,只能通过web界面来添加。","可配置爬虫","自定义爬虫"],"Usage/Spider/CustomizedSpider.html":["crawlab会自动发现project_source_file_folder目录下的所有爬虫目录,并将这些目录生成自定义爬虫并集成到crawlab中。因此,将爬虫项目目录拷贝到project_source_file_folder目录下,就可以添加一个爬虫了。","在定义爬虫中,我们需要配置一下执行命令(运行爬虫时后台执行的shell命令)和结果集(通过crawlab_collection传递给爬虫程序,爬虫程序存储结果的地方),然后点击保存按钮保存爬虫信息。","在通过web界面上传之前,需要将爬虫项目文件打包成zip格式。","接下来,我们就可以部署、运行自定义爬虫了。","然后,在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮,选择自定义爬虫,点击上传按钮,选择刚刚打包好的zip文件。上传成功后,爬虫列表中会出现新添加的自定义爬虫。这样就算添加好了。","自定义爬虫","自定义爬虫是指用户可以添加的任何语言任何框架的爬虫,高度自定义化。当用户添加好自定义爬虫之后,crawlab就可以将其集成到爬虫管理的系统中来。","自定义爬虫的添加有两种方式:","这个方式稍微有些繁琐,但是对于无法轻松获取服务器的读写权限时是非常有用的,适合在生产环境上使用。","这种方式非常方便,但是需要获得主机服务器的读写权限,因而比较适合在开发环境上采用。","通过web界面上传","通过web界面上传爬虫","通过创建项目目录","通过添加项目目录","配置爬虫"],"Usage/Spider/ConfigurableSpider.html":["&","crawlab的可配置爬虫是基于scrapy的,因此天生支持并发。而且,可配置爬虫完全支持自定义爬虫的一般功能,因此也支持任务调度、任务监控、日志监控、数据分析。","仅列表页。这也是最简单的形式,爬虫遍历列表上的列表项,将数据抓取下来。","仅详情页。爬虫只抓取详情页。","分页选择器","列表+详情页。爬虫先遍历列表页,将列表项中的详情页地址提取出来并跟进抓取详情页。","列表页字段","列表项的匹和分页按钮的匹配查询,由css或xpath来进行匹配。","列表项选择器","可配置爬虫","可配置爬虫是版本v0.2.1开发的功能。目的是将具有相似网站结构的爬虫项目可配置化,将开发爬虫的过程流程化,大大提高爬虫开发效率。","在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮。","在检查完目标网页的元素css选择器之后,我们输入列表项选择器、开始url、列表页/详情页等信息。注意勾选url为详情页url。","开始url","抓取类别","添加完成后,可以看到刚刚添加的可配置爬虫出现了在最下方,点击查看进入到爬虫详情。","添加爬虫","点击保存、预览,查看预览内容。","点击可配置爬虫。","点击配置标签进入到配置页面。接下来,我们需要对爬虫规则进行配置。","爬虫最开始遍历的网址。","详情页字段","输入完基本信息,点击添加。","这个默认是开启的。如果开启,爬虫将先抓取网站的robots.txt并判断页面是否可抓;否则,不会对此进行验证。用户可以选择将其关闭。请注意,任何无视robots协议的行为都有法律风险。","这也是爬虫抓取采用的策略,也就是爬虫遍历网页是如何进行的。作为第一个版本,我们有仅列表、仅详情页、列表+详情页。","这些都是再列表页或详情页中需要提取的字段。字段由css选择器或者xpath来匹配提取。可以选择文本或者属性。","这里已经有一些配置好的初始输入项。我们简单介绍一下各自的含义。","这里我们选择列表+详情页。","遵守robots协议","配置爬虫"],"Usage/Spider/Deploy.html":["在爬虫列表中点击操作列的部署按钮,将指定爬虫部署到所有在线节点中;","在爬虫列表中点击部署所有爬虫,将所有爬虫部署到所有在线节点中;","在爬虫详情的概览标签中,点击部署按钮,将指定爬虫部署到所有在线节点中。","这里的爬虫部署是指自定义爬虫的部署,因为可配置爬虫已经内嵌到crawlab中了,所有节点都可以使用,不需要额外部署。简单来说,就是将主机上的爬虫源代码通过http的方式打包传输至worker节点上,因此节点就可以运行传输过来的爬虫了。","部署好之后,我们就可以运行爬虫了。","部署爬虫","部署爬虫很简单,有三种方式:"],"Usage/Spider/Run.html":["在爬虫列表中操作列点击运行按钮,或者","在爬虫详情中概览标签下点击运行按钮,或者","定时任务触发","定时任务触发是比较常用的功能,对于增量抓取或对实时性有要求的任务很重要。这在定时任务中会详细介绍。","对于自定义爬虫,可以在配置标签下点击运行按钮","我们有两种运行爬虫的方式:","手动触发","然后,crawlab会提示任务已经派发到队列中去了,然后你可以在爬虫详情左侧看到新创建的任务。点击创建时间可以导航至任务详情。","运行爬虫"],"Usage/Spider/Analytics.html":["在运行了一段时间之后,爬虫会积累一些统计数据,例如运行成功率、任务数、运行时长等指标。crawlab将这些指标汇总并呈现给开发者。","统计数据","要查看统计数据的话,只需要在爬虫详情中,点击分析标签,就可以看到爬虫的统计数据了。"],"Usage/Task/":["下载结果","任务","任务其实就是指某一次抓取任务或采集任务。任务与爬虫关联,其执行的也是爬虫指定的执行命令或采集规则。抓取或采集的结果与任务关联,因此可以查看到每一次任务的结果集。crawlab的任务是整个采集流程的核心,抓取的过程都是跟任务关联起来的,因此任务对于crawlab来说非常重要。任务被app触发,worker通过任务队列接收任务,然后在其所在节点上执行任务。","操作任务","本小节将介绍以下内容:","查看任务"],"Usage/Task/View.html":["任务列表","任务日志","任务结果","查看任务","点击侧边栏的任务导航至任务列表。可以看到最近的10个生成的任务。可以根据节点、爬虫来过滤任务。","点击操作列的查看按钮,进入到该任务的任务详情。","点击日志标签,可以查看任务日志。","点击结果标签,可以查看任务结果。"],"Usage/Task/Action.html":["停止任务","删除任务","在任务列表中,点击操作列中的删除按钮,确认删除该任务。","导航至需要停止的任务的任务详情,点击停止按钮来终止任务。","当任务运行起来之后,我们因为某个原因可能需要终止任务,这时我们需要在crawlab中停止该任务。","操作任务"],"Usage/Task/DownloadResults.html":["下载结果","导航至任务详情,点击结果标签,点击下载csv按钮,等待一会儿,结果就会以csv的形式下载到本地。","结果储存在数据库中之后,我们有时候需要将其导出,这时可以在界面中进行导出操作。"],"Usage/Schedule/":["job,apscheduler调度引擎将会不断的去数据库中匹配任务的执行时间,如果执行时间满足要求,则会在后台触发一次任务运行。","tasks,在linux中也被称为crontab。定时任务可以让任务可以被执行多次,而用户则不用手动的操作来执行任务。在生产环境中,这非常常见。定时任务对于对增量抓取或对数据实时性有要求的用户来说非常有用。","修改定时任务","创建定时任务","删除定时任务","在crawlab中,定时任务是通过apscheduler来实现的。创建一个定时任务之后,会在名为mongo的jobstore中创建一个period","定时任务","定时任务列表会进行更新。每一次爬虫更新、删除、创建,以及定时任务的更新、删除、创建,都会触发定时任务列表的更新。","定时任务是指定某个时刻,重复性地执行的任务,英文叫做period","导航至定时任务页面,可以看到定时任务的列表。","导航至定时任务页面,点击操作列的修改按钮,弹出修改定时任务的弹框。填写相应的内容,点击提交按钮修改定时任务。","导航至定时任务页面,点击操作列的删除按钮,确认删除该任务。","点击添加定时任务,弹出创建定时任务的弹框。填写相应的内容,点击提交按钮创建定时任务。","这里的cron跟linux中的crontab是一致的。如果对crontab不了解,可以参考这篇文章。"],"Usage/Site/":["网站","网站信息是帮助用户查看站长之家收录网站的信息的,包含robots协议、首页响应等信息。"],"Architecture/":["admin的单页应用。其中重用了很多el","app","app.py来启动应用。","backend","broker","crawlab的架构跟celery非常相似,但是加入了包括前端、爬虫、flower在内的额外模块,以支持爬虫管理的功能。架构图如下。","element","flower","frontend","node","spider","task","ui的控件来支持相应的展示。","一个celery的插件,用于监控celery节点。","中间者","中间者跟celery中定义的一样,作为运行异步任务的队列。","任务","任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。","前端","前端其实就是一个基于vue","后台应用","架构","爬虫","爬虫源代码或配置规则储存在app上,需要被部署到各个worker节点中。","节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口。","这是一个flask应用,提供了必要的api来支持常规操作,例如crud、爬虫部署以及任务运行。每一个节点需要启动flask应用来支持爬虫部署。运行python"],"Examples/":["与scrapy集成","样例"],"Examples/ScrapyIntegration.html":["#","'192.168.99.100'","'crawlab_test'","'test'","27017","=","class","col","col_nam","col_name:","db","db[col_name]","def","exampl","import","item","item,","item['task_id']","juejinpipeline(object):","mongo","mongo[mongo_db]","mongo_db","mongo_host","mongo_port","mongocli","mongoclient(host=mongo_host,","os","os.environ.get('crawlab_collection')","os.environ.get('crawlab_task_id')","pipelin","port=mongo_port)","process_item(self,","pymongo","return","scrapi","self.col.save(item)","spider):","与scrapy集成","以下是crawlab跟scrapy集成的例子,利用了crawlab传过来的task_id和collection_name。"]},"length":25},"tokenStore":{"root":{"1":{"6":{"docs":{},".":{"0":{"4":{"docs":{},"是":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}},"docs":{}},"docs":{}}},"docs":{}},"2":{"7":{"0":{"1":{"7":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},":":{"2":{"7":{"0":{"1":{"7":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"3":{"0":{"docs":{},"秒":{"docs":{},"的":{"docs":{},"时":{"docs":{},"间":{"docs":{},"来":{"docs":{},"b":{"docs":{},"u":{"docs":{},"i":{"docs":{},"l":{"docs":{},"d":{"docs":{},"前":{"docs":{},"端":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},",":{"docs":{},"之":{"docs":{},"后":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"打":{"docs":{},"开":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"地":{"docs":{},"址":{"docs":{},"地":{"docs":{},"址":{"docs":{},"看":{"docs":{},"到":{"docs":{},"界":{"docs":{},"面":{"docs":{},"了":{"docs":{},"。":{"docs":{},"界":{"docs":{},"面":{"docs":{},"地":{"docs":{},"址":{"docs":{},"默":{"docs":{},"认":{"docs":{},"为":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"8":{"0":{"0":{"0":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"8":{"0":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"./":{"ref":"./","tf":0.1111111111111111},"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.014634146341463415}},"主":{"docs":{},"要":{"docs":{},"解":{"docs":{},"决":{"docs":{},"的":{"docs":{},"是":{"docs":{},"大":{"docs":{},"量":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"困":{"docs":{},"难":{"docs":{},"的":{"docs":{},"问":{"docs":{},"题":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"需":{"docs":{},"要":{"docs":{},"监":{"docs":{},"控":{"docs":{},"上":{"docs":{},"百":{"docs":{},"个":{"docs":{},"网":{"docs":{},"站":{"docs":{},"的":{"docs":{},"参":{"docs":{},"杂":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"和":{"docs":{},"s":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"n":{"docs":{},"i":{"docs":{},"u":{"docs":{},"m":{"docs":{},"的":{"docs":{},"项":{"docs":{},"目":{"docs":{},"不":{"docs":{},"容":{"docs":{},"易":{"docs":{},"做":{"docs":{},"到":{"docs":{},"同":{"docs":{},"时":{"docs":{},"管":{"docs":{},"理":{"docs":{},",":{"docs":{},"而":{"docs":{},"且":{"docs":{},"命":{"docs":{},"令":{"docs":{},"行":{"docs":{},"管":{"docs":{},"理":{"docs":{},"的":{"docs":{},"成":{"docs":{},"本":{"docs":{},"非":{"docs":{},"常":{"docs":{},"高":{"docs":{},",":{"docs":{},"还":{"docs":{},"容":{"docs":{},"易":{"docs":{},"出":{"docs":{},"错":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"支":{"docs":{},"持":{"docs":{},"任":{"docs":{},"何":{"docs":{},"语":{"docs":{},"言":{"docs":{},"和":{"docs":{},"任":{"docs":{},"何":{"docs":{},"框":{"docs":{},"架":{"docs":{},",":{"docs":{},"配":{"docs":{},"合":{"docs":{},"任":{"docs":{},"务":{"docs":{},"调":{"docs":{},"度":{"docs":{},"、":{"docs":{},"任":{"docs":{},"务":{"docs":{},"监":{"docs":{},"控":{"docs":{},",":{"docs":{},"很":{"docs":{},"容":{"docs":{},"易":{"docs":{},"做":{"docs":{},"到":{"docs":{},"对":{"docs":{},"成":{"docs":{},"规":{"docs":{},"模":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"进":{"docs":{},"行":{"docs":{},"有":{"docs":{},"效":{"docs":{},"监":{"docs":{},"控":{"docs":{},"管":{"docs":{},"理":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"基":{"docs":{},"于":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"的":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"平":{"docs":{},"台":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"集":{"docs":{},"成":{"docs":{},"任":{"docs":{},"何":{"docs":{},"语":{"docs":{},"言":{"docs":{},"和":{"docs":{},"任":{"docs":{},"何":{"docs":{},"框":{"docs":{},"架":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"简":{"docs":{},"介":{"docs":{"./":{"ref":"./","tf":10}}}},"允":{"docs":{},"许":{"docs":{},"用":{"docs":{},"户":{"docs":{},"创":{"docs":{},"建":{"docs":{},"两":{"docs":{},"种":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},":":{"docs":{"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2}}}}}}}}}}}}},"会":{"docs":{},"自":{"docs":{},"动":{"docs":{},"发":{"docs":{},"现":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"_":{"docs":{},"s":{"docs":{},"o":{"docs":{},"u":{"docs":{},"r":{"docs":{},"c":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"i":{"docs":{},"l":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},"的":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"目":{"docs":{},"录":{"docs":{},",":{"docs":{},"并":{"docs":{},"将":{"docs":{},"这":{"docs":{},"些":{"docs":{},"目":{"docs":{},"录":{"docs":{},"生":{"docs":{},"成":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"并":{"docs":{},"集":{"docs":{},"成":{"docs":{},"到":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"中":{"docs":{},"。":{"docs":{},"因":{"docs":{},"此":{"docs":{},",":{"docs":{},"将":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{},"拷":{"docs":{},"贝":{"docs":{},"到":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"_":{"docs":{},"s":{"docs":{},"o":{"docs":{},"u":{"docs":{},"r":{"docs":{},"c":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"i":{"docs":{},"l":{"docs":{},"e":{"docs":{},"_":{"docs":{},"f":{"docs":{},"o":{"docs":{},"l":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},",":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"添":{"docs":{},"加":{"docs":{},"一":{"docs":{},"个":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"的":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"是":{"docs":{},"基":{"docs":{},"于":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"的":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"天":{"docs":{},"生":{"docs":{},"支":{"docs":{},"持":{"docs":{},"并":{"docs":{},"发":{"docs":{},"。":{"docs":{},"而":{"docs":{},"且":{"docs":{},",":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"完":{"docs":{},"全":{"docs":{},"支":{"docs":{},"持":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"一":{"docs":{},"般":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"也":{"docs":{},"支":{"docs":{},"持":{"docs":{},"任":{"docs":{},"务":{"docs":{},"调":{"docs":{},"度":{"docs":{},"、":{"docs":{},"任":{"docs":{},"务":{"docs":{},"监":{"docs":{},"控":{"docs":{},"、":{"docs":{},"日":{"docs":{},"志":{"docs":{},"监":{"docs":{},"控":{"docs":{},"、":{"docs":{},"数":{"docs":{},"据":{"docs":{},"分":{"docs":{},"析":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"架":{"docs":{},"构":{"docs":{},"跟":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"非":{"docs":{},"常":{"docs":{},"相":{"docs":{},"似":{"docs":{},",":{"docs":{},"但":{"docs":{},"是":{"docs":{},"加":{"docs":{},"入":{"docs":{},"了":{"docs":{},"包":{"docs":{},"括":{"docs":{},"前":{"docs":{},"端":{"docs":{},"、":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"、":{"docs":{},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{},"在":{"docs":{},"内":{"docs":{},"的":{"docs":{},"额":{"docs":{},"外":{"docs":{},"模":{"docs":{},"块":{"docs":{},",":{"docs":{},"以":{"docs":{},"支":{"docs":{},"持":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"的":{"docs":{},"功":{"docs":{},"能":{"docs":{},"。":{"docs":{},"架":{"docs":{},"构":{"docs":{},"图":{"docs":{},"如":{"docs":{},"下":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"n":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"m":{"docs":{},"\"":{"docs":{},"]":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}},"o":{"docs":{},"m":{"docs":{},"p":{"docs":{},"o":{"docs":{},"s":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"e":{"docs":{},".":{"docs":{},"y":{"docs":{},"m":{"docs":{},"l":{"docs":{},"后":{"docs":{},",":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"运":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"启":{"docs":{},"动":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}},"定":{"docs":{},"义":{"docs":{},"如":{"docs":{},"下":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}},"更":{"docs":{},"改":{"docs":{},"为":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"的":{"docs":{},"y":{"docs":{},"a":{"docs":{},"m":{"docs":{},"l":{"docs":{},"文":{"docs":{},"件":{"docs":{},"来":{"docs":{},"定":{"docs":{},"义":{"docs":{},"需":{"docs":{},"要":{"docs":{},"启":{"docs":{},"动":{"docs":{},"的":{"docs":{},"容":{"docs":{},"器":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"是":{"docs":{},"单":{"docs":{},"个":{"docs":{},",":{"docs":{},"也":{"docs":{},"可":{"docs":{},"以":{"docs":{},"(":{"docs":{},"通":{"docs":{},"常":{"docs":{},")":{"docs":{},"是":{"docs":{},"多":{"docs":{},"个":{"docs":{},"的":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"也":{"docs":{},"很":{"docs":{},"简":{"docs":{},"单":{"docs":{},",":{"docs":{},"大":{"docs":{},"家":{"docs":{},"去":{"docs":{},"网":{"docs":{},"上":{"docs":{},"百":{"docs":{},"度":{"docs":{},"一":{"docs":{},"下":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"了":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}},"和":{"docs":{},"定":{"docs":{},"义":{"docs":{},"好":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"是":{"docs":{},"一":{"docs":{},"个":{"docs":{},"集":{"docs":{},"群":{"docs":{},"管":{"docs":{},"理":{"docs":{},"方":{"docs":{},"式":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"利":{"docs":{},"用":{"docs":{},"名":{"docs":{},"为":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"很":{"docs":{},"适":{"docs":{},"合":{"docs":{},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"部":{"docs":{},"署":{"docs":{},",":{"docs":{},"在":{"docs":{},"原":{"docs":{},"有":{"docs":{},"的":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"基":{"docs":{},"础":{"docs":{},"上":{"docs":{},"增":{"docs":{},"加":{"docs":{},"几":{"docs":{},"个":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},",":{"docs":{},"达":{"docs":{},"到":{"docs":{},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"部":{"docs":{},"署":{"docs":{},"的":{"docs":{},"目":{"docs":{},"的":{"docs":{},"。":{"docs":{},"将":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"来":{"docs":{},"部":{"docs":{},"署":{"docs":{},"。":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}},"n":{"docs":{},"t":{"docs":{},"a":{"docs":{},"i":{"docs":{},"n":{"docs":{},"e":{"docs":{},"r":{"docs":{},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}},"l":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.04081632653061224}},"e":{"docs":{},":":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375}}},"l":{"docs":{},"o":{"docs":{},"n":{"docs":{},"e":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"a":{"docs":{},"s":{"docs":{},"s":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}},"d":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"e":{"docs":{},"m":{"docs":{},"o":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}},"p":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"s":{"docs":{},"_":{"docs":{},"o":{"docs":{},"n":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}}},"v":{"docs":{},".":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"m":{"docs":{},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}},"f":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25},"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":10.029268292682927}},"安":{"docs":{},"装":{"docs":{},"部":{"docs":{},"署":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}},"b":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},"[":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{},"]":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}},"基":{"docs":{},"于":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"平":{"docs":{},"台":{"docs":{},",":{"docs":{},"支":{"docs":{},"持":{"docs":{},"多":{"docs":{},"种":{"docs":{},"编":{"docs":{},"程":{"docs":{},"语":{"docs":{},"言":{"docs":{},"以":{"docs":{},"及":{"docs":{},"多":{"docs":{},"种":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"框":{"docs":{},"架":{"docs":{},".":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"本":{"docs":{},"使":{"docs":{},"用":{"docs":{},"手":{"docs":{},"册":{"docs":{},"会":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"您":{"docs":{},"解":{"docs":{},"决":{"docs":{},"在":{"docs":{},"安":{"docs":{},"装":{"docs":{},"使":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"遇":{"docs":{},"到":{"docs":{},"的":{"docs":{},"任":{"docs":{},"何":{"docs":{},"问":{"docs":{},"题":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"小":{"docs":{},"节":{"docs":{},"将":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"三":{"docs":{},"种":{"docs":{},"安":{"docs":{},"装":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25}}}}}}}}}}}}}}}},"如":{"docs":{},"何":{"docs":{},"使":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},",":{"docs":{},"包":{"docs":{},"括":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},":":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2}}}}}}}}}}}}}}}}}}}}},"以":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},":":{"docs":{"Usage/Task/":{"ref":"Usage/Task/","tf":0.16666666666666666}}}}}}}}}}}}},"查":{"docs":{},"看":{"docs":{},"演":{"docs":{},"示":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}},"节":{"docs":{},"点":{"docs":{"Usage/Node/":{"ref":"Usage/Node/","tf":0.25}},"列":{"docs":{},"表":{"docs":{"Usage/Node/View.html":{"ref":"Usage/Node/View.html","tf":10.333333333333334}}}}}},"任":{"docs":{},"务":{"docs":{"Usage/Task/":{"ref":"Usage/Task/","tf":0.16666666666666666},"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":10.125}}}}}},"项":{"docs":{},"目":{"docs":{},"自":{"docs":{},"今":{"docs":{},"年":{"docs":{},"三":{"docs":{},"月":{"docs":{},"份":{"docs":{},"上":{"docs":{},"线":{"docs":{},"以":{"docs":{},"来":{"docs":{},"受":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"爱":{"docs":{},"好":{"docs":{},"者":{"docs":{},"们":{"docs":{},"和":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"们":{"docs":{},"的":{"docs":{},"好":{"docs":{},"评":{"docs":{},",":{"docs":{},"不":{"docs":{},"少":{"docs":{},"使":{"docs":{},"用":{"docs":{},"者":{"docs":{},"还":{"docs":{},"表":{"docs":{},"示":{"docs":{},"会":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"搭":{"docs":{},"建":{"docs":{},"公":{"docs":{},"司":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"平":{"docs":{},"台":{"docs":{},"。":{"docs":{},"经":{"docs":{},"过":{"docs":{},"近":{"3":{"docs":{},"个":{"docs":{},"月":{"docs":{},"的":{"docs":{},"迭":{"docs":{},"代":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"陆":{"docs":{},"续":{"docs":{},"上":{"docs":{},"线":{"docs":{},"了":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"、":{"docs":{},"数":{"docs":{},"据":{"docs":{},"分":{"docs":{},"析":{"docs":{},"、":{"docs":{},"网":{"docs":{},"站":{"docs":{},"信":{"docs":{},"息":{"docs":{},"、":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"、":{"docs":{},"自":{"docs":{},"动":{"docs":{},"提":{"docs":{},"取":{"docs":{},"字":{"docs":{},"段":{"docs":{},"、":{"docs":{},"下":{"docs":{},"载":{"docs":{},"结":{"docs":{},"果":{"docs":{},"、":{"docs":{},"上":{"docs":{},"传":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"等":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"将":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"打":{"docs":{},"造":{"docs":{},"得":{"docs":{},"更":{"docs":{},"加":{"docs":{},"实":{"docs":{},"用":{"docs":{},",":{"docs":{},"更":{"docs":{},"加":{"docs":{},"全":{"docs":{},"面":{"docs":{},",":{"docs":{},"能":{"docs":{},"够":{"docs":{},"真":{"docs":{},"正":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"用":{"docs":{},"户":{"docs":{},"解":{"docs":{},"决":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"困":{"docs":{},"难":{"docs":{},"的":{"docs":{},"问":{"docs":{},"题":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"首":{"docs":{},"先":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"来":{"docs":{},"看":{"docs":{},"如":{"docs":{},"何":{"docs":{},"安":{"docs":{},"装":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"吧":{"docs":{},",":{"docs":{},"请":{"docs":{},"查":{"docs":{},"看":{"docs":{},"安":{"docs":{},"装":{"docs":{},"。":{"docs":{"./":{"ref":"./","tf":0.1111111111111111}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"将":{"docs":{},"g":{"docs":{},"i":{"docs":{},"t":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},"上":{"docs":{},"的":{"docs":{},"代":{"docs":{},"码":{"docs":{},"拉":{"docs":{},"取":{"docs":{},"到":{"docs":{},"本":{"docs":{},"地":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}},"安":{"docs":{},"装":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/":{"ref":"Installation/","tf":10}}}}}}}}},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}},"完":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},",":{"docs":{},"在":{"docs":{},"u":{"docs":{},"b":{"docs":{},"u":{"docs":{},"n":{"docs":{},"t":{"docs":{},"u":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}},"前":{"docs":{},"端":{"docs":{},"所":{"docs":{},"需":{"docs":{},"库":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}},"后":{"docs":{},"端":{"docs":{},"所":{"docs":{},"需":{"docs":{},"库":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":10.0125}},"是":{"docs":{},"之":{"docs":{},"前":{"docs":{},"没":{"docs":{},"有":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"时":{"docs":{},"的":{"docs":{},"部":{"docs":{},"署":{"docs":{},"方":{"docs":{},"式":{"docs":{},",":{"docs":{},"相":{"docs":{},"对":{"docs":{},"于":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"部":{"docs":{},"署":{"docs":{},"来":{"docs":{},"说":{"docs":{},"有":{"docs":{},"些":{"docs":{},"繁":{"docs":{},"琐":{"docs":{},"。":{"docs":{},"但":{"docs":{},"了":{"docs":{},"解":{"docs":{},"如":{"docs":{},"何":{"docs":{},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{},"可":{"docs":{},"以":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"更":{"docs":{},"深":{"docs":{},"入":{"docs":{},"地":{"docs":{},"理":{"docs":{},"解":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"是":{"docs":{},"如":{"docs":{},"何":{"docs":{},"构":{"docs":{},"建":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"的":{"docs":{},"。":{"docs":{},"这":{"docs":{},"里":{"docs":{},"简":{"docs":{},"单":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"一":{"docs":{},"下":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"预":{"docs":{},"览":{"docs":{},"模":{"docs":{},"式":{"docs":{"Installation/":{"ref":"Installation/","tf":0.25},"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":10.125}},"是":{"docs":{},"一":{"docs":{},"种":{"docs":{},"让":{"docs":{},"用":{"docs":{},"户":{"docs":{},"比":{"docs":{},"较":{"docs":{},"快":{"docs":{},"的":{"docs":{},"上":{"docs":{},"手":{"docs":{},"的":{"docs":{},"一":{"docs":{},"种":{"docs":{},"部":{"docs":{},"署":{"docs":{},"模":{"docs":{},"式":{"docs":{},"。":{"docs":{},"跟":{"docs":{},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{},"类":{"docs":{},"似":{"docs":{},",":{"docs":{},"但":{"docs":{},"不":{"docs":{},"用":{"docs":{},"经":{"docs":{},"过":{"docs":{},"构":{"docs":{},"建":{"docs":{},"、":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"和":{"docs":{},"启":{"docs":{},"动":{"docs":{},"服":{"docs":{},"务":{"docs":{},"的":{"docs":{},"步":{"docs":{},"骤":{"docs":{},"。":{"docs":{},"在":{"docs":{},"启":{"docs":{},"动":{"docs":{},"时":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"了":{"docs":{},"。":{"docs":{},"相":{"docs":{},"较":{"docs":{},"于":{"docs":{},"直":{"docs":{},"接":{"docs":{},"部":{"docs":{},"署":{"docs":{},"来":{"docs":{},"说":{"docs":{},"方":{"docs":{},"便":{"docs":{},"一":{"docs":{},"些":{"docs":{},"。":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"\"":{"2":{"7":{"0":{"1":{"7":{"docs":{},":":{"2":{"7":{"0":{"1":{"7":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}},"6":{"3":{"7":{"9":{"docs":{},":":{"6":{"3":{"7":{"9":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"8":{"0":{"0":{"0":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"1":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"2":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"8":{"0":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"\"":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}},"docs":{},"r":{"docs":{},"e":{"docs":{},"g":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"r":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}},"#":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.06829268292682927},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375},"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}},"'":{"1":{"9":{"2":{"docs":{},".":{"1":{"6":{"8":{"docs":{},".":{"9":{"9":{"docs":{},".":{"1":{"0":{"0":{"docs":{},"'":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"3":{"docs":{},".":{"3":{"docs":{},"'":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}},"docs":{}}},"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{},"'":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{},"'":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}},"/":{"docs":{},"b":{"docs":{},"i":{"docs":{},"n":{"docs":{},"/":{"docs":{},"s":{"docs":{},"h":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},".":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"p":{"docs":{},"y":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},":":{"docs":{},"/":{"docs":{},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"j":{"docs":{},"e":{"docs":{},"n":{"docs":{},"k":{"docs":{},"i":{"docs":{},"n":{"docs":{},"s":{"docs":{},"_":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"s":{"docs":{},"p":{"docs":{},"a":{"docs":{},"c":{"docs":{},"e":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"d":{"docs":{},"e":{"docs":{},"v":{"docs":{},"e":{"docs":{},"l":{"docs":{},"o":{"docs":{},"p":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"o":{"docs":{},"p":{"docs":{},"t":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"_":{"docs":{},"i":{"docs":{},"n":{"docs":{},"i":{"docs":{},"t":{"docs":{},".":{"docs":{},"s":{"docs":{},"h":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"[":{"docs":{},"\"":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},"s":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"r":{"docs":{},"e":{"docs":{},"g":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"r":{"docs":{},"y":{"docs":{},".":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},"]":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}},"\\":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.024390243902439025}}},"a":{"docs":{},"l":{"docs":{},"w":{"docs":{},"a":{"docs":{},"y":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}},"p":{"docs":{},"p":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}},"y":{"docs":{},"来":{"docs":{},"启":{"docs":{},"动":{"docs":{},"应":{"docs":{},"用":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}},"i":{"docs":{},"服":{"docs":{},"务":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}},"d":{"docs":{},"m":{"docs":{},"i":{"docs":{},"n":{"docs":{},"的":{"docs":{},"单":{"docs":{},"页":{"docs":{},"应":{"docs":{},"用":{"docs":{},"。":{"docs":{},"其":{"docs":{},"中":{"docs":{},"重":{"docs":{},"用":{"docs":{},"了":{"docs":{},"很":{"docs":{},"多":{"docs":{},"e":{"docs":{},"l":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{},"r":{"docs":{},"y":{"docs":{},"p":{"docs":{},"o":{"docs":{},"i":{"docs":{},"n":{"docs":{},"t":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}}}},"l":{"docs":{},"e":{"docs":{},"m":{"docs":{},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}},"x":{"docs":{},"a":{"docs":{},"m":{"docs":{},"p":{"docs":{},"l":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}},"i":{"docs":{},"m":{"docs":{},"a":{"docs":{},"g":{"docs":{},"e":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.03902439024390244}}}}}},"p":{"docs":{},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.04081632653061224}}}}}}},"n":{"docs":{},"d":{"docs":{},"e":{"docs":{},"x":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},".":{"docs":{},"h":{"docs":{},"t":{"docs":{},"m":{"docs":{},"l":{"docs":{},";":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}},"s":{"docs":{},"t":{"docs":{},"a":{"docs":{},"l":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.05}}}}}}},"t":{"docs":{},"e":{"docs":{},"m":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},",":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}},"[":{"docs":{},"'":{"docs":{},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"'":{"docs":{},"]":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.014634146341463415}},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}},"n":{"docs":{},"a":{"docs":{},"g":{"docs":{},"e":{"docs":{},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}},"i":{"docs":{},"r":{"docs":{},"r":{"docs":{},"o":{"docs":{},"r":{"docs":{},"s":{"docs":{},"\"":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.024390243902439025},"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"l":{"docs":{},"a":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}},"一":{"docs":{},"行":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{},"如":{"docs":{},"何":{"docs":{},"安":{"docs":{},"装":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"跟":{"docs":{},"操":{"docs":{},"作":{"docs":{},"系":{"docs":{},"统":{"docs":{},"有":{"docs":{},"关":{"docs":{},",":{"docs":{},"这":{"docs":{},"里":{"docs":{},"就":{"docs":{},"不":{"docs":{},"展":{"docs":{},"开":{"docs":{},"讲":{"docs":{},"了":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"的":{"docs":{},"同":{"docs":{},"学":{"docs":{},"自":{"docs":{},"行":{"docs":{},"百":{"docs":{},"度":{"docs":{},"一":{"docs":{},"下":{"docs":{},"相":{"docs":{},"关":{"docs":{},"教":{"docs":{},"程":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"[":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"_":{"docs":{},"d":{"docs":{},"b":{"docs":{},"]":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}},"_":{"docs":{},"d":{"docs":{},"b":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}},"p":{"docs":{},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}},"c":{"docs":{},"l":{"docs":{},"i":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},"e":{"docs":{},"n":{"docs":{},"t":{"docs":{},"(":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},"=":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"_":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},",":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375}}}}}},"p":{"docs":{},"m":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.025}}}},"o":{"docs":{},"d":{"docs":{},"e":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}},"p":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.014634146341463415}},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.03902439024390244}}}},"=":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"_":{"docs":{},"p":{"docs":{},"o":{"docs":{},"r":{"docs":{},"t":{"docs":{},")":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}},"u":{"docs":{},"l":{"docs":{},"l":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}},"i":{"docs":{},"p":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"e":{"docs":{},"l":{"docs":{},"i":{"docs":{},"n":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}},"m":{"2":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0625}}},"docs":{}},"y":{"docs":{},"t":{"docs":{},"h":{"docs":{},"o":{"docs":{},"n":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}},"r":{"docs":{},"o":{"docs":{},"c":{"docs":{},"e":{"docs":{},"s":{"docs":{},"s":{"docs":{},"_":{"docs":{},"i":{"docs":{},"t":{"docs":{},"e":{"docs":{},"m":{"docs":{},"(":{"docs":{},"s":{"docs":{},"e":{"docs":{},"l":{"docs":{},"f":{"docs":{},",":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"l":{"docs":{},"a":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}}}}},"s":{"docs":{},"t":{"docs":{},"a":{"docs":{},"r":{"docs":{},"t":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}},"l":{"docs":{},"o":{"docs":{},"a":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"q":{"docs":{},"u":{"docs":{},"i":{"docs":{},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"t":{"docs":{},"u":{"docs":{},"r":{"docs":{},"n":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}},"m":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"u":{"docs":{},"n":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125},"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}},"o":{"docs":{},"o":{"docs":{},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"s":{"docs":{},"e":{"docs":{},"r":{"docs":{},"v":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}},"i":{"docs":{},"c":{"docs":{},"e":{"docs":{},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}},"e":{"docs":{},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}},"来":{"docs":{},"进":{"docs":{},"行":{"docs":{},"的":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"是":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"模":{"docs":{},"式":{"docs":{},"。":{"docs":{},"注":{"docs":{},"意":{"docs":{},":":{"docs":{},"强":{"docs":{},"烈":{"docs":{},"不":{"docs":{},"建":{"docs":{},"议":{"docs":{},"在":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"中":{"docs":{},"用":{"docs":{},"预":{"docs":{},"览":{"docs":{},"模":{"docs":{},"式":{"docs":{},"。":{"docs":{},"预":{"docs":{},"览":{"docs":{},"模":{"docs":{},"式":{"docs":{},"只":{"docs":{},"是":{"docs":{},"让":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"快":{"docs":{},"速":{"docs":{},"体":{"docs":{},"验":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"以":{"docs":{},"及":{"docs":{},"调":{"docs":{},"试":{"docs":{},"代":{"docs":{},"码":{"docs":{},"问":{"docs":{},"题":{"docs":{},"的":{"docs":{},"一":{"docs":{},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},",":{"docs":{},"而":{"docs":{},"不":{"docs":{},"是":{"docs":{},"用":{"docs":{},"作":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"部":{"docs":{},"署":{"docs":{},"的":{"docs":{},"。":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"l":{"docs":{},"f":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},".":{"docs":{},"s":{"docs":{},"a":{"docs":{},"v":{"docs":{},"e":{"docs":{},"(":{"docs":{},"i":{"docs":{},"t":{"docs":{},"e":{"docs":{},"m":{"docs":{},")":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}},"t":{"docs":{},"a":{"docs":{},"r":{"docs":{},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0375}}}}}},"u":{"docs":{},"d":{"docs":{},"o":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"p":{"docs":{},"i":{"docs":{},"d":{"docs":{},"e":{"docs":{},"r":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},")":{"docs":{},":":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}},"t":{"docs":{},"i":{"docs":{},"k":{"docs":{},"a":{"docs":{},"z":{"docs":{},"y":{"docs":{},"q":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}},":":{"docs":{},"l":{"docs":{},"a":{"docs":{},"t":{"docs":{},"e":{"docs":{},"s":{"docs":{},"t":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.024390243902439025}}}}}}}}}}}}}}}}}}}}}}},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"s":{"docs":{},",":{"docs":{},"在":{"docs":{},"l":{"docs":{},"i":{"docs":{},"n":{"docs":{},"u":{"docs":{},"x":{"docs":{},"中":{"docs":{},"也":{"docs":{},"被":{"docs":{},"称":{"docs":{},"为":{"docs":{},"c":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"可":{"docs":{},"以":{"docs":{},"让":{"docs":{},"任":{"docs":{},"务":{"docs":{},"可":{"docs":{},"以":{"docs":{},"被":{"docs":{},"执":{"docs":{},"行":{"docs":{},"多":{"docs":{},"次":{"docs":{},",":{"docs":{},"而":{"docs":{},"用":{"docs":{},"户":{"docs":{},"则":{"docs":{},"不":{"docs":{},"用":{"docs":{},"手":{"docs":{},"动":{"docs":{},"的":{"docs":{},"操":{"docs":{},"作":{"docs":{},"来":{"docs":{},"执":{"docs":{},"行":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"在":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"中":{"docs":{},",":{"docs":{},"这":{"docs":{},"非":{"docs":{},"常":{"docs":{},"常":{"docs":{},"见":{"docs":{},"。":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"对":{"docs":{},"于":{"docs":{},"对":{"docs":{},"增":{"docs":{},"量":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"或":{"docs":{},"对":{"docs":{},"数":{"docs":{},"据":{"docs":{},"实":{"docs":{},"时":{"docs":{},"性":{"docs":{},"有":{"docs":{},"要":{"docs":{},"求":{"docs":{},"的":{"docs":{},"用":{"docs":{},"户":{"docs":{},"来":{"docs":{},"说":{"docs":{},"非":{"docs":{},"常":{"docs":{},"有":{"docs":{},"用":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"u":{"docs":{},"p":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"i":{"docs":{},"的":{"docs":{},"控":{"docs":{},"件":{"docs":{},"来":{"docs":{},"支":{"docs":{},"持":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"展":{"docs":{},"示":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}},"v":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}},"e":{"docs":{},"r":{"docs":{},"s":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561}}}}}}}}},"o":{"docs":{},"l":{"docs":{},"u":{"docs":{},"m":{"docs":{},"n":{"docs":{},"s":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}}}}},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"1":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"2":{"docs":{},":":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.00975609756097561},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},",":{"docs":{},"他":{"docs":{},"们":{"docs":{},"通":{"docs":{},"过":{"docs":{},"连":{"docs":{},"接":{"docs":{},"到":{"docs":{},"配":{"docs":{},"置":{"docs":{},"好":{"docs":{},"的":{"docs":{},"b":{"docs":{},"r":{"docs":{},"o":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"(":{"docs":{},"通":{"docs":{},"常":{"docs":{},"是":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},")":{"docs":{},"来":{"docs":{},"进":{"docs":{},"行":{"docs":{},"与":{"docs":{},"主":{"docs":{},"机":{"docs":{},"的":{"docs":{},"通":{"docs":{},"信":{"docs":{},"。":{"docs":{"Usage/Node/View.html":{"ref":"Usage/Node/View.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"{":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}},"}":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805},"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}},"下":{"docs":{},"载":{"docs":{},"镜":{"docs":{},"像":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}},"结":{"docs":{},"果":{"docs":{"Usage/Task/":{"ref":"Usage/Task/","tf":0.16666666666666666},"Usage/Task/DownloadResults.html":{"ref":"Usage/Task/DownloadResults.html","tf":10.333333333333334}}}}}},"其":{"docs":{},"中":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"映":{"docs":{},"射":{"docs":{},"了":{"8":{"0":{"8":{"0":{"docs":{},"端":{"docs":{},"口":{"docs":{},"(":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"前":{"docs":{},"端":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},")":{"docs":{},"以":{"docs":{},"及":{"8":{"0":{"0":{"0":{"docs":{},"端":{"docs":{},"口":{"docs":{},"(":{"docs":{},"后":{"docs":{},"端":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},")":{"docs":{},"到":{"docs":{},"宿":{"docs":{},"主":{"docs":{},"机":{"docs":{},"。":{"docs":{},"另":{"docs":{},"外":{"docs":{},"还":{"docs":{},"将":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"和":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"映":{"docs":{},"射":{"docs":{},"到":{"docs":{},"了":{"docs":{},"容":{"docs":{},"器":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},"。":{"docs":{},"传":{"docs":{},"入":{"docs":{},"参":{"docs":{},"数":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"是":{"docs":{},"代":{"docs":{},"表":{"docs":{},"该":{"docs":{},"启":{"docs":{},"动":{"docs":{},"方":{"docs":{},"式":{"docs":{},"为":{"docs":{},"主":{"docs":{},"机":{"docs":{},"启":{"docs":{},"动":{"docs":{},"模":{"docs":{},"式":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"所":{"docs":{},"有":{"docs":{},"服":{"docs":{},"务":{"docs":{},"(":{"docs":{},"前":{"docs":{},"端":{"docs":{},"、":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"、":{"docs":{},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{},"、":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},")":{"docs":{},"都":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"docs":{},"。":{"docs":{},"另":{"docs":{},"外":{"docs":{},"一":{"docs":{},"个":{"docs":{},"模":{"docs":{},"式":{"docs":{},"是":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"模":{"docs":{},"式":{"docs":{},",":{"docs":{},"只":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"docs":{},"必":{"docs":{},"要":{"docs":{},"的":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"和":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"服":{"docs":{},"务":{"docs":{},",":{"docs":{},"这":{"docs":{},"个":{"docs":{},"对":{"docs":{},"于":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"部":{"docs":{},"署":{"docs":{},"比":{"docs":{},"较":{"docs":{},"有":{"docs":{},"用":{"docs":{},"。":{"docs":{},"等":{"docs":{},"待":{"docs":{},"大":{"docs":{},"约":{"2":{"0":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}},"r":{"docs":{},"o":{"docs":{},"o":{"docs":{},"t":{"docs":{},"是":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},"的":{"docs":{},"根":{"docs":{},"目":{"docs":{},"录":{"docs":{},",":{"docs":{},"这":{"docs":{},"里":{"docs":{},"是":{"docs":{},"n":{"docs":{},"p":{"docs":{},"m":{"docs":{},"打":{"docs":{},"包":{"docs":{},"好":{"docs":{},"后":{"docs":{},"的":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"前":{"docs":{},"端":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"一":{"docs":{},"个":{"docs":{},"基":{"docs":{},"于":{"docs":{},"v":{"docs":{},"u":{"docs":{},"e":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}},"者":{"docs":{},"可":{"docs":{},"以":{"docs":{},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"和":{"docs":{},"创":{"docs":{},"建":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"来":{"docs":{},"添":{"docs":{},"加":{"docs":{},",":{"docs":{},"后":{"docs":{},"者":{"docs":{},"由":{"docs":{},"于":{"docs":{},"没":{"docs":{},"有":{"docs":{},"源":{"docs":{},"代":{"docs":{},"码":{"docs":{},",":{"docs":{},"只":{"docs":{},"能":{"docs":{},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"来":{"docs":{},"添":{"docs":{},"加":{"docs":{},"。":{"docs":{"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"同":{"docs":{},"样":{"docs":{},",":{"docs":{},"在":{"docs":{},"浏":{"docs":{},"览":{"docs":{},"器":{"docs":{},"中":{"docs":{},"输":{"docs":{},"入":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"界":{"docs":{},"面":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.01951219512195122}}}}}}},"面":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"让":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"运":{"docs":{},"行":{"docs":{},"在":{"docs":{},"各":{"docs":{},"个":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"让":{"docs":{},"主":{"docs":{},"机":{"docs":{},"与":{"docs":{},"节":{"docs":{},"点":{"docs":{},"进":{"docs":{},"行":{"docs":{},"通":{"docs":{},"信":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"需":{"docs":{},"要":{"docs":{},"知":{"docs":{},"道":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},"和":{"docs":{},"端":{"docs":{},"口":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"手":{"docs":{},"动":{"docs":{},"配":{"docs":{},"置":{"docs":{},"一":{"docs":{},"下":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"和":{"docs":{},"端":{"docs":{},"口":{"docs":{},"。":{"docs":{},"在":{"docs":{},"节":{"docs":{},"点":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},"点":{"docs":{},"击":{"docs":{},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"里":{"docs":{},"的":{"docs":{},"蓝":{"docs":{},"色":{"docs":{},"查":{"docs":{},"看":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"节":{"docs":{},"点":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{},"节":{"docs":{},"点":{"docs":{},"详":{"docs":{},"情":{"docs":{},"样":{"docs":{},"子":{"docs":{},"如":{"docs":{},"下":{"docs":{},"。":{"docs":{"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":0.25}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"台":{"docs":{},"应":{"docs":{},"用":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"模":{"docs":{},"式":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}},"对":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"不":{"docs":{},"了":{"docs":{},"解":{"docs":{},"的":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"参":{"docs":{},"考":{"docs":{},"一":{"docs":{},"下":{"docs":{},"这":{"docs":{},"篇":{"docs":{},"文":{"docs":{},"章":{"docs":{},"(":{"9":{"1":{"0":{"2":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}},"于":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"配":{"docs":{},"置":{"docs":{},"标":{"docs":{},"签":{"docs":{},"下":{"docs":{},"点":{"docs":{},"击":{"docs":{},"运":{"docs":{},"行":{"docs":{},"按":{"docs":{},"钮":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}}}}},"年":{"docs":{},"了":{"docs":{},",":{"docs":{},"学":{"docs":{},"点":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}},"当":{"docs":{},"然":{"docs":{},",":{"docs":{},"也":{"docs":{},"可":{"docs":{},"以":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}},"任":{"docs":{},"务":{"docs":{},"运":{"docs":{},"行":{"docs":{},"起":{"docs":{},"来":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"因":{"docs":{},"为":{"docs":{},"某":{"docs":{},"个":{"docs":{},"原":{"docs":{},"因":{"docs":{},"可":{"docs":{},"能":{"docs":{},"需":{"docs":{},"要":{"docs":{},"终":{"docs":{},"止":{"docs":{},"任":{"docs":{},"务":{"docs":{},",":{"docs":{},"这":{"docs":{},"时":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"在":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"中":{"docs":{},"停":{"docs":{},"止":{"docs":{},"该":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":0.16666666666666666}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"我":{"docs":{},"们":{"docs":{},"已":{"docs":{},"经":{"docs":{},"在":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},"上":{"docs":{},"构":{"docs":{},"建":{"docs":{},"了":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},",":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"将":{"docs":{},"其":{"docs":{},"p":{"docs":{},"u":{"docs":{},"l":{"docs":{},"l":{"docs":{},"下":{"docs":{},"来":{"docs":{},"使":{"docs":{},"用":{"docs":{},"。":{"docs":{},"在":{"docs":{},"p":{"docs":{},"u":{"docs":{},"l":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"有":{"docs":{},"两":{"docs":{},"种":{"docs":{},"运":{"docs":{},"行":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"将":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"下":{"docs":{},"载":{"docs":{},"下":{"docs":{},"来":{"docs":{},"。":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"大":{"docs":{},"小":{"docs":{},"大":{"docs":{},"概":{"docs":{},"在":{"docs":{},"几":{"docs":{},"百":{"docs":{},"兆":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"下":{"docs":{},"载":{"docs":{},"需":{"docs":{},"要":{"docs":{},"几":{"docs":{},"分":{"docs":{},"钟":{"docs":{},"时":{"docs":{},"间":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"拷":{"docs":{},"贝":{"docs":{},"一":{"docs":{},"份":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"以":{"docs":{},"及":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"到":{"docs":{},"某":{"docs":{},"一":{"docs":{},"个":{"docs":{},"地":{"docs":{},"方":{"docs":{},"。":{"docs":{},"例":{"docs":{},"如":{"docs":{},"我":{"docs":{},"的":{"docs":{},"例":{"docs":{},"子":{"docs":{},",":{"docs":{},"分":{"docs":{},"别":{"docs":{},"为":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"和":{"docs":{},"/":{"docs":{},"h":{"docs":{},"o":{"docs":{},"m":{"docs":{},"e":{"docs":{},"/":{"docs":{},"y":{"docs":{},"e":{"docs":{},"q":{"docs":{},"i":{"docs":{},"n":{"docs":{},"g":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"更":{"docs":{},"改":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},",":{"docs":{},"将":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"、":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"的":{"docs":{},"指":{"docs":{},"向":{"docs":{},"i":{"docs":{},"p":{"docs":{},"更":{"docs":{},"改":{"docs":{},"为":{"docs":{},"自":{"docs":{},"己":{"docs":{},"数":{"docs":{},"据":{"docs":{},"的":{"docs":{},"值":{"docs":{},"。":{"docs":{},"注":{"docs":{},"意":{"docs":{},",":{"docs":{},"容":{"docs":{},"器":{"docs":{},"中":{"docs":{},"对":{"docs":{},"应":{"docs":{},"的":{"docs":{},"宿":{"docs":{},"主":{"docs":{},"机":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},"不":{"docs":{},"是":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},",":{"docs":{},"而":{"docs":{},"是":{"1":{"7":{"2":{"docs":{},".":{"1":{"7":{"docs":{},".":{"0":{"docs":{},".":{"1":{"docs":{},"(":{"docs":{},"当":{"docs":{},"然":{"docs":{},"也":{"docs":{},"可":{"docs":{},"以":{"docs":{},"用":{"docs":{},"n":{"docs":{},"e":{"docs":{},"t":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"来":{"docs":{},"做":{"docs":{},",":{"docs":{},"只":{"docs":{},"是":{"docs":{},"稍":{"docs":{},"微":{"docs":{},"麻":{"docs":{},"烦":{"docs":{},"一":{"docs":{},"些":{"docs":{},")":{"docs":{},"。":{"docs":{},"更":{"docs":{},"改":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},",":{"docs":{},"将":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"地":{"docs":{},"址":{"docs":{},"v":{"docs":{},"u":{"docs":{},"e":{"docs":{},"_":{"docs":{},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},"_":{"docs":{},"b":{"docs":{},"a":{"docs":{},"s":{"docs":{},"e":{"docs":{},"_":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"更":{"docs":{},"改":{"docs":{},"为":{"docs":{},"宿":{"docs":{},"主":{"docs":{},"机":{"docs":{},"所":{"docs":{},"在":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"1":{"9":{"2":{"docs":{},".":{"1":{"6":{"8":{"docs":{},".":{"0":{"docs":{},".":{"8":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},",":{"docs":{},"这":{"docs":{},"将":{"docs":{},"是":{"docs":{},"前":{"docs":{},"端":{"docs":{},"调":{"docs":{},"用":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"会":{"docs":{},"用":{"docs":{},"到":{"docs":{},"的":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}},"docs":{}}},"docs":{}},"docs":{}}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"好":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"接":{"docs":{},"下":{"docs":{},"来":{"docs":{},"就":{"docs":{},"是":{"docs":{},"运":{"docs":{},"行":{"docs":{},"容":{"docs":{},"器":{"docs":{},"了":{"docs":{},"。":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"来":{"docs":{},"启":{"docs":{},"动":{"docs":{},"容":{"docs":{},"器":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}},"知":{"docs":{},"识":{"docs":{},")":{"docs":{},"做":{"docs":{},"进":{"docs":{},"一":{"docs":{},"步":{"docs":{},"了":{"docs":{},"解":{"docs":{},"。":{"docs":{},"简":{"docs":{},"单":{"docs":{},"来":{"docs":{},"说":{"docs":{},",":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"可":{"docs":{},"以":{"docs":{},"利":{"docs":{},"用":{"docs":{},"已":{"docs":{},"存":{"docs":{},"在":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"构":{"docs":{},"建":{"docs":{},"一":{"docs":{},"些":{"docs":{},"常":{"docs":{},"用":{"docs":{},"的":{"docs":{},"服":{"docs":{},"务":{"docs":{},"和":{"docs":{},"应":{"docs":{},"用":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"、":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"、":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"等":{"docs":{},"等":{"docs":{},"。":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"运":{"docs":{},"行":{"docs":{},"一":{"docs":{},"个":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"d":{"docs":{},"b":{"docs":{},"服":{"docs":{},"务":{"docs":{},"仅":{"docs":{},"需":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"运":{"docs":{},"行":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"容":{"docs":{},"器":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":10.090909090909092}}}}}},"这":{"docs":{},"应":{"docs":{},"该":{"docs":{},"是":{"docs":{},"部":{"docs":{},"署":{"docs":{},"应":{"docs":{},"用":{"docs":{},"的":{"docs":{},"最":{"docs":{},"方":{"docs":{},"便":{"docs":{},"也":{"docs":{},"是":{"docs":{},"最":{"docs":{},"节":{"docs":{},"省":{"docs":{},"时":{"docs":{},"间":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"了":{"docs":{},"。":{"docs":{},"在":{"docs":{},"最":{"docs":{},"近":{"docs":{},"的":{"docs":{},"一":{"docs":{},"次":{"docs":{},"版":{"docs":{},"本":{"docs":{},"更":{"docs":{},"新":{"docs":{},"v":{"0":{"docs":{},".":{"2":{"docs":{},".":{"3":{"docs":{},"中":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"发":{"docs":{},"布":{"docs":{},"了":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"让":{"docs":{},"大":{"docs":{},"家":{"docs":{},"可":{"docs":{},"以":{"docs":{},"利":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"来":{"docs":{},"轻":{"docs":{},"松":{"docs":{},"部":{"docs":{},"署":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{},"下":{"docs":{},"面":{"docs":{},"将":{"docs":{},"一":{"docs":{},"步":{"docs":{},"一":{"docs":{},"步":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"如":{"docs":{},"何":{"docs":{},"使":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"来":{"docs":{},"部":{"docs":{},"署":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}},"docs":{}}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"样":{"docs":{},"的":{"docs":{},"话":{"docs":{},",":{"docs":{},"p":{"docs":{},"u":{"docs":{},"l":{"docs":{},"l":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"的":{"docs":{},"速":{"docs":{},"度":{"docs":{},"会":{"docs":{},"比":{"docs":{},"不":{"docs":{},"改":{"docs":{},"变":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"源":{"docs":{},"的":{"docs":{},"速":{"docs":{},"度":{"docs":{},"快":{"docs":{},"很":{"docs":{},"多":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}},",":{"docs":{},"p":{"docs":{},"m":{"2":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"3":{"docs":{},"个":{"docs":{},"守":{"docs":{},"护":{"docs":{},"进":{"docs":{},"程":{"docs":{},"来":{"docs":{},"管":{"docs":{},"理":{"docs":{},"这":{"3":{"docs":{},"个":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"如":{"docs":{},"果":{"docs":{},"想":{"docs":{},"看":{"docs":{},"后":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"的":{"docs":{},"日":{"docs":{},"志":{"docs":{},"的":{"docs":{},"话":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}}}}}}}}}},"docs":{}}}}},"docs":{}}},"我":{"docs":{},"们":{"docs":{},"就":{"docs":{},"完":{"docs":{},"成":{"docs":{},"了":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"配":{"docs":{},"置":{"docs":{},"工":{"docs":{},"作":{"docs":{},"。":{"docs":{"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":0.25}}}}}}}}}}}}}}}}}},"里":{"docs":{},"先":{"docs":{},"定":{"docs":{},"义":{"docs":{},"了":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"主":{"docs":{},"节":{"docs":{},"点":{"docs":{},"。":{"docs":{},"m":{"docs":{},"a":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"r":{"docs":{},"依":{"docs":{},"赖":{"docs":{},"于":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"和":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"容":{"docs":{},"器":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"在":{"docs":{},"启":{"docs":{},"动":{"docs":{},"之":{"docs":{},"前":{"docs":{},"会":{"docs":{},"同":{"docs":{},"时":{"docs":{},"启":{"docs":{},"动":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"和":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"容":{"docs":{},"器":{"docs":{},"。":{"docs":{},"这":{"docs":{},"样":{"docs":{},"就":{"docs":{},"不":{"docs":{},"需":{"docs":{},"要":{"docs":{},"单":{"docs":{},"独":{"docs":{},"配":{"docs":{},"置":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"和":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"服":{"docs":{},"务":{"docs":{},"了":{"docs":{},",":{"docs":{},"大":{"docs":{},"大":{"docs":{},"节":{"docs":{},"省":{"docs":{},"了":{"docs":{},"环":{"docs":{},"境":{"docs":{},"配":{"docs":{},"置":{"docs":{},"的":{"docs":{},"时":{"docs":{},"间":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"启":{"docs":{},"动":{"docs":{},"了":{"docs":{},"多":{"docs":{},"增":{"docs":{},"加":{"docs":{},"了":{"docs":{},"两":{"docs":{},"个":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},",":{"docs":{},"以":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"模":{"docs":{},"式":{"docs":{},"启":{"docs":{},"动":{"docs":{},"。":{"docs":{},"这":{"docs":{},"样":{"docs":{},",":{"docs":{},"多":{"docs":{},"节":{"docs":{},"点":{"docs":{},"部":{"docs":{},"署":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"分":{"docs":{},"布":{"docs":{},"式":{"docs":{},"部":{"docs":{},"署":{"docs":{},"就":{"docs":{},"完":{"docs":{},"成":{"docs":{},"了":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"指":{"docs":{},"启":{"docs":{},"动":{"docs":{},"后":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"用":{"docs":{},"p":{"docs":{},"m":{"2":{"docs":{},"来":{"docs":{},"管":{"docs":{},"理":{"docs":{},"进":{"docs":{},"程":{"docs":{},"。":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}},"docs":{}}}}}}}}}}}}}}},"的":{"docs":{},"构":{"docs":{},"建":{"docs":{},"是":{"docs":{},"指":{"docs":{},"前":{"docs":{},"端":{"docs":{},"构":{"docs":{},"建":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"执":{"docs":{},"行":{"docs":{},"以":{"docs":{},"下":{"docs":{},"命":{"docs":{},"令":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"是":{"docs":{},"指":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"部":{"docs":{},"署":{"docs":{},",":{"docs":{},"因":{"docs":{},"为":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"已":{"docs":{},"经":{"docs":{},"内":{"docs":{},"嵌":{"docs":{},"到":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"中":{"docs":{},"了":{"docs":{},",":{"docs":{},"所":{"docs":{},"有":{"docs":{},"节":{"docs":{},"点":{"docs":{},"都":{"docs":{},"可":{"docs":{},"以":{"docs":{},"使":{"docs":{},"用":{"docs":{},",":{"docs":{},"不":{"docs":{},"需":{"docs":{},"要":{"docs":{},"额":{"docs":{},"外":{"docs":{},"部":{"docs":{},"署":{"docs":{},"。":{"docs":{},"简":{"docs":{},"单":{"docs":{},"来":{"docs":{},"说":{"docs":{},",":{"docs":{},"就":{"docs":{},"是":{"docs":{},"将":{"docs":{},"主":{"docs":{},"机":{"docs":{},"上":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"源":{"docs":{},"代":{"docs":{},"码":{"docs":{},"通":{"docs":{},"过":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},"的":{"docs":{},"方":{"docs":{},"式":{"docs":{},"打":{"docs":{},"包":{"docs":{},"传":{"docs":{},"输":{"docs":{},"至":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"节":{"docs":{},"点":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"运":{"docs":{},"行":{"docs":{},"传":{"docs":{},"输":{"docs":{},"过":{"docs":{},"来":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"跟":{"docs":{},"l":{"docs":{},"i":{"docs":{},"n":{"docs":{},"u":{"docs":{},"x":{"docs":{},"中":{"docs":{},"的":{"docs":{},"c":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"a":{"docs":{},"b":{"docs":{},"是":{"docs":{},"一":{"docs":{},"致":{"docs":{},"的":{"docs":{},"。":{"docs":{},"如":{"docs":{},"果":{"docs":{},"对":{"docs":{},"c":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"a":{"docs":{},"b":{"docs":{},"不":{"docs":{},"了":{"docs":{},"解":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"参":{"docs":{},"考":{"docs":{},"这":{"docs":{},"篇":{"docs":{},"文":{"docs":{},"章":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"已":{"docs":{},"经":{"docs":{},"有":{"docs":{},"一":{"docs":{},"些":{"docs":{},"配":{"docs":{},"置":{"docs":{},"好":{"docs":{},"的":{"docs":{},"初":{"docs":{},"始":{"docs":{},"输":{"docs":{},"入":{"docs":{},"项":{"docs":{},"。":{"docs":{},"我":{"docs":{},"们":{"docs":{},"简":{"docs":{},"单":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"一":{"docs":{},"下":{"docs":{},"各":{"docs":{},"自":{"docs":{},"的":{"docs":{},"含":{"docs":{},"义":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"我":{"docs":{},"们":{"docs":{},"选":{"docs":{},"择":{"docs":{},"列":{"docs":{},"表":{"docs":{},"+":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}},"个":{"docs":{},"方":{"docs":{},"式":{"docs":{},"稍":{"docs":{},"微":{"docs":{},"有":{"docs":{},"些":{"docs":{},"繁":{"docs":{},"琐":{"docs":{},",":{"docs":{},"但":{"docs":{},"是":{"docs":{},"对":{"docs":{},"于":{"docs":{},"无":{"docs":{},"法":{"docs":{},"轻":{"docs":{},"松":{"docs":{},"获":{"docs":{},"取":{"docs":{},"服":{"docs":{},"务":{"docs":{},"器":{"docs":{},"的":{"docs":{},"读":{"docs":{},"写":{"docs":{},"权":{"docs":{},"限":{"docs":{},"时":{"docs":{},"是":{"docs":{},"非":{"docs":{},"常":{"docs":{},"有":{"docs":{},"用":{"docs":{},"的":{"docs":{},",":{"docs":{},"适":{"docs":{},"合":{"docs":{},"在":{"docs":{},"生":{"docs":{},"产":{"docs":{},"环":{"docs":{},"境":{"docs":{},"上":{"docs":{},"使":{"docs":{},"用":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"默":{"docs":{},"认":{"docs":{},"是":{"docs":{},"开":{"docs":{},"启":{"docs":{},"的":{"docs":{},"。":{"docs":{},"如":{"docs":{},"果":{"docs":{},"开":{"docs":{},"启":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"将":{"docs":{},"先":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"网":{"docs":{},"站":{"docs":{},"的":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},".":{"docs":{},"t":{"docs":{},"x":{"docs":{},"t":{"docs":{},"并":{"docs":{},"判":{"docs":{},"断":{"docs":{},"页":{"docs":{},"面":{"docs":{},"是":{"docs":{},"否":{"docs":{},"可":{"docs":{},"抓":{"docs":{},";":{"docs":{},"否":{"docs":{},"则":{"docs":{},",":{"docs":{},"不":{"docs":{},"会":{"docs":{},"对":{"docs":{},"此":{"docs":{},"进":{"docs":{},"行":{"docs":{},"验":{"docs":{},"证":{"docs":{},"。":{"docs":{},"用":{"docs":{},"户":{"docs":{},"可":{"docs":{},"以":{"docs":{},"选":{"docs":{},"择":{"docs":{},"将":{"docs":{},"其":{"docs":{},"关":{"docs":{},"闭":{"docs":{},"。":{"docs":{},"请":{"docs":{},"注":{"docs":{},"意":{"docs":{},",":{"docs":{},"任":{"docs":{},"何":{"docs":{},"无":{"docs":{},"视":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},"协":{"docs":{},"议":{"docs":{},"的":{"docs":{},"行":{"docs":{},"为":{"docs":{},"都":{"docs":{},"有":{"docs":{},"法":{"docs":{},"律":{"docs":{},"风":{"docs":{},"险":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},"非":{"docs":{},"常":{"docs":{},"方":{"docs":{},"便":{"docs":{},",":{"docs":{},"但":{"docs":{},"是":{"docs":{},"需":{"docs":{},"要":{"docs":{},"获":{"docs":{},"得":{"docs":{},"主":{"docs":{},"机":{"docs":{},"服":{"docs":{},"务":{"docs":{},"器":{"docs":{},"的":{"docs":{},"读":{"docs":{},"写":{"docs":{},"权":{"docs":{},"限":{"docs":{},",":{"docs":{},"因":{"docs":{},"而":{"docs":{},"比":{"docs":{},"较":{"docs":{},"适":{"docs":{},"合":{"docs":{},"在":{"docs":{},"开":{"docs":{},"发":{"docs":{},"环":{"docs":{},"境":{"docs":{},"上":{"docs":{},"采":{"docs":{},"用":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"也":{"docs":{},"是":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"采":{"docs":{},"用":{"docs":{},"的":{"docs":{},"策":{"docs":{},"略":{"docs":{},",":{"docs":{},"也":{"docs":{},"就":{"docs":{},"是":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"网":{"docs":{},"页":{"docs":{},"是":{"docs":{},"如":{"docs":{},"何":{"docs":{},"进":{"docs":{},"行":{"docs":{},"的":{"docs":{},"。":{"docs":{},"作":{"docs":{},"为":{"docs":{},"第":{"docs":{},"一":{"docs":{},"个":{"docs":{},"版":{"docs":{},"本":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"有":{"docs":{},"仅":{"docs":{},"列":{"docs":{},"表":{"docs":{},"、":{"docs":{},"仅":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"、":{"docs":{},"列":{"docs":{},"表":{"docs":{},"+":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"些":{"docs":{},"都":{"docs":{},"是":{"docs":{},"再":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},"或":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"中":{"docs":{},"需":{"docs":{},"要":{"docs":{},"提":{"docs":{},"取":{"docs":{},"的":{"docs":{},"字":{"docs":{},"段":{"docs":{},"。":{"docs":{},"字":{"docs":{},"段":{"docs":{},"由":{"docs":{},"c":{"docs":{},"s":{"docs":{},"s":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{},"或":{"docs":{},"者":{"docs":{},"x":{"docs":{},"p":{"docs":{},"a":{"docs":{},"t":{"docs":{},"h":{"docs":{},"来":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"提":{"docs":{},"取":{"docs":{},"。":{"docs":{},"可":{"docs":{},"以":{"docs":{},"选":{"docs":{},"择":{"docs":{},"文":{"docs":{},"本":{"docs":{},"或":{"docs":{},"者":{"docs":{},"属":{"docs":{},"性":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"一":{"docs":{},"个":{"docs":{},"f":{"docs":{},"l":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"应":{"docs":{},"用":{"docs":{},",":{"docs":{},"提":{"docs":{},"供":{"docs":{},"了":{"docs":{},"必":{"docs":{},"要":{"docs":{},"的":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"来":{"docs":{},"支":{"docs":{},"持":{"docs":{},"常":{"docs":{},"规":{"docs":{},"操":{"docs":{},"作":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"c":{"docs":{},"r":{"docs":{},"u":{"docs":{},"d":{"docs":{},"、":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"以":{"docs":{},"及":{"docs":{},"任":{"docs":{},"务":{"docs":{},"运":{"docs":{},"行":{"docs":{},"。":{"docs":{},"每":{"docs":{},"一":{"docs":{},"个":{"docs":{},"节":{"docs":{},"点":{"docs":{},"需":{"docs":{},"要":{"docs":{},"启":{"docs":{},"动":{"docs":{},"f":{"docs":{},"l":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"应":{"docs":{},"用":{"docs":{},"来":{"docs":{},"支":{"docs":{},"持":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"。":{"docs":{},"运":{"docs":{},"行":{"docs":{},"p":{"docs":{},"y":{"docs":{},"t":{"docs":{},"h":{"docs":{},"o":{"docs":{},"n":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"镜":{"docs":{},"像":{"docs":{},"之":{"docs":{},"前":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"配":{"docs":{},"置":{"docs":{},"一":{"docs":{},"下":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"源":{"docs":{},"。":{"docs":{},"因":{"docs":{},"为":{"docs":{},"我":{"docs":{},"们":{"docs":{},"在":{"docs":{},"墙":{"docs":{},"内":{"docs":{},",":{"docs":{},"使":{"docs":{},"用":{"docs":{},"原":{"docs":{},"有":{"docs":{},"的":{"docs":{},"镜":{"docs":{},"像":{"docs":{},"源":{"docs":{},"速":{"docs":{},"度":{"docs":{},"非":{"docs":{},"常":{"docs":{},"感":{"docs":{},"人":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"将":{"docs":{},"使":{"docs":{},"用":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},"在":{"docs":{},"国":{"docs":{},"内":{"docs":{},"的":{"docs":{},"加":{"docs":{},"速":{"docs":{},"器":{"docs":{},"。":{"docs":{},"创":{"docs":{},"建":{"docs":{},"/":{"docs":{},"e":{"docs":{},"t":{"docs":{},"c":{"docs":{},"/":{"docs":{},"d":{"docs":{},"o":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"/":{"docs":{},"d":{"docs":{},"a":{"docs":{},"e":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},".":{"docs":{},"j":{"docs":{},"s":{"docs":{},"o":{"docs":{},"n":{"docs":{},"文":{"docs":{},"件":{"docs":{},",":{"docs":{},"在":{"docs":{},"其":{"docs":{},"中":{"docs":{},"输":{"docs":{},"入":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Installation/Docker.html":{"ref":"Installation/Docker.html","tf":0.004878048780487805}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},".":{"docs":{},".":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}},"b":{"docs":{},"u":{"docs":{},"i":{"docs":{},"l":{"docs":{},"d":{"docs":{},":":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}},"a":{"docs":{},"c":{"docs":{},"k":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}},"r":{"docs":{},"o":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}},"f":{"docs":{},"l":{"docs":{},"o":{"docs":{},"w":{"docs":{},"e":{"docs":{},"r":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},".":{"docs":{},"p":{"docs":{},"i":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}},"g":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"i":{"docs":{},"t":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},"s":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"g":{"docs":{},"i":{"docs":{},"t":{"docs":{},"h":{"docs":{},"u":{"docs":{},"b":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"m":{"docs":{},"/":{"docs":{},"t":{"docs":{},"i":{"docs":{},"k":{"docs":{},"a":{"docs":{},"z":{"docs":{},"y":{"docs":{},"q":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"l":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}},"o":{"docs":{},"g":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}},"y":{"docs":{},"a":{"docs":{},"r":{"docs":{},"n":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.025}}}}}},"分":{"docs":{},"别":{"docs":{},"配":{"docs":{},"置":{"docs":{},"前":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"/":{"docs":{},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},".":{"docs":{},"p":{"docs":{},"r":{"docs":{},"o":{"docs":{},"d":{"docs":{},"u":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"和":{"docs":{},"后":{"docs":{},"端":{"docs":{},"配":{"docs":{},"置":{"docs":{},"文":{"docs":{},"件":{"docs":{},".":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"i":{"docs":{},"g":{"docs":{},".":{"docs":{},"p":{"docs":{},"y":{"docs":{},"。":{"docs":{},"分":{"docs":{},"别":{"docs":{},"需":{"docs":{},"要":{"docs":{},"对":{"docs":{},"部":{"docs":{},"署":{"docs":{},"后":{"docs":{},"a":{"docs":{},"p":{"docs":{},"i":{"docs":{},"地":{"docs":{},"址":{"docs":{},"以":{"docs":{},"及":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"地":{"docs":{},"址":{"docs":{},"进":{"docs":{},"行":{"docs":{},"配":{"docs":{},"置":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"页":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}},"启":{"docs":{},"动":{"docs":{},"服":{"docs":{},"务":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"拉":{"docs":{},"取":{"docs":{},"代":{"docs":{},"码":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}},"构":{"docs":{},"建":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"完":{"docs":{},"成":{"docs":{},"后":{"docs":{},",":{"docs":{},"会":{"docs":{},"在":{"docs":{},".":{"docs":{},"/":{"docs":{},"f":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},"t":{"docs":{},"e":{"docs":{},"n":{"docs":{},"d":{"docs":{},"目":{"docs":{},"录":{"docs":{},"下":{"docs":{},"创":{"docs":{},"建":{"docs":{},"一":{"docs":{},"个":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},"t":{"docs":{},"文":{"docs":{},"件":{"docs":{},"夹":{"docs":{},",":{"docs":{},"里":{"docs":{},"面":{"docs":{},"是":{"docs":{},"打":{"docs":{},"包":{"docs":{},"好":{"docs":{},"后":{"docs":{},"的":{"docs":{},"静":{"docs":{},"态":{"docs":{},"文":{"docs":{},"件":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"添":{"docs":{},"加":{"docs":{},"/":{"docs":{},"e":{"docs":{},"t":{"docs":{},"c":{"docs":{},"/":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"/":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},".":{"docs":{},"d":{"docs":{},"/":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},".":{"docs":{},"c":{"docs":{},"o":{"docs":{},"n":{"docs":{},"f":{"docs":{},"文":{"docs":{},"件":{"docs":{},",":{"docs":{},"输":{"docs":{},"入":{"docs":{},"以":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"完":{"docs":{},"成":{"docs":{},"后":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"刚":{"docs":{},"刚":{"docs":{},"添":{"docs":{},"加":{"docs":{},"的":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"出":{"docs":{},"现":{"docs":{},"了":{"docs":{},"在":{"docs":{},"最":{"docs":{},"下":{"docs":{},"方":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"查":{"docs":{},"看":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}},"然":{"docs":{},"后":{"docs":{},"在":{"docs":{},"浏":{"docs":{},"览":{"docs":{},"器":{"docs":{},"中":{"docs":{},"输":{"docs":{},"入":{"docs":{},"h":{"docs":{},"t":{"docs":{},"t":{"docs":{},"p":{"docs":{},":":{"docs":{},"/":{"docs":{},"/":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"8":{"0":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"界":{"docs":{},"面":{"docs":{},"了":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}}}}},",":{"docs":{},"在":{"docs":{},"侧":{"docs":{},"边":{"docs":{},"栏":{"docs":{},"点":{"docs":{},"击":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"添":{"docs":{},"加":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"选":{"docs":{},"择":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"上":{"docs":{},"传":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"选":{"docs":{},"择":{"docs":{},"刚":{"docs":{},"刚":{"docs":{},"打":{"docs":{},"包":{"docs":{},"好":{"docs":{},"的":{"docs":{},"z":{"docs":{},"i":{"docs":{},"p":{"docs":{},"文":{"docs":{},"件":{"docs":{},"。":{"docs":{},"上":{"docs":{},"传":{"docs":{},"成":{"docs":{},"功":{"docs":{},"后":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},"会":{"docs":{},"出":{"docs":{},"现":{"docs":{},"新":{"docs":{},"添":{"docs":{},"加":{"docs":{},"的":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"。":{"docs":{},"这":{"docs":{},"样":{"docs":{},"就":{"docs":{},"算":{"docs":{},"添":{"docs":{},"加":{"docs":{},"好":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"会":{"docs":{},"提":{"docs":{},"示":{"docs":{},"任":{"docs":{},"务":{"docs":{},"已":{"docs":{},"经":{"docs":{},"派":{"docs":{},"发":{"docs":{},"到":{"docs":{},"队":{"docs":{},"列":{"docs":{},"中":{"docs":{},"去":{"docs":{},"了":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"你":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"左":{"docs":{},"侧":{"docs":{},"看":{"docs":{},"到":{"docs":{},"新":{"docs":{},"创":{"docs":{},"建":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"点":{"docs":{},"击":{"docs":{},"创":{"docs":{},"建":{"docs":{},"时":{"docs":{},"间":{"docs":{},"可":{"docs":{},"以":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"现":{"docs":{},"在":{"docs":{},",":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"启":{"docs":{},"动":{"docs":{},"n":{"docs":{},"g":{"docs":{},"i":{"docs":{},"n":{"docs":{},"x":{"docs":{},"服":{"docs":{},"务":{"docs":{},"就":{"docs":{},"完":{"docs":{},"成":{"docs":{},"了":{"docs":{},"启":{"docs":{},"动":{"docs":{},"前":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}}}}}}}}}}}}}}}}}}}}}}}}}}}},"配":{"docs":{},"置":{"docs":{"Installation/Direct.html":{"ref":"Installation/Direct.html","tf":0.0125}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667},"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}},"该":{"docs":{},"模":{"docs":{},"式":{"docs":{},"同":{"docs":{},"样":{"docs":{},"会":{"docs":{},"启":{"docs":{},"动":{"3":{"docs":{},"个":{"docs":{},"后":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"和":{"1":{"docs":{},"个":{"docs":{},"前":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"。":{"docs":{},"前":{"docs":{},"端":{"docs":{},"服":{"docs":{},"务":{"docs":{},"是":{"docs":{},"通":{"docs":{},"过":{"docs":{},"n":{"docs":{},"p":{"docs":{},"m":{"docs":{"Installation/Preview.html":{"ref":"Installation/Preview.html","tf":0.125}}}}}}}}}}}}}}}}}}},"docs":{}}}}}}}},"docs":{}}}}}}}}},"任":{"docs":{},"务":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Task/":{"ref":"Usage/Task/","tf":10.166666666666666},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"指":{"docs":{},"某":{"docs":{},"一":{"docs":{},"次":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"任":{"docs":{},"务":{"docs":{},"或":{"docs":{},"采":{"docs":{},"集":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"任":{"docs":{},"务":{"docs":{},"与":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"关":{"docs":{},"联":{"docs":{},",":{"docs":{},"其":{"docs":{},"执":{"docs":{},"行":{"docs":{},"的":{"docs":{},"也":{"docs":{},"是":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"指":{"docs":{},"定":{"docs":{},"的":{"docs":{},"执":{"docs":{},"行":{"docs":{},"命":{"docs":{},"令":{"docs":{},"或":{"docs":{},"采":{"docs":{},"集":{"docs":{},"规":{"docs":{},"则":{"docs":{},"。":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"或":{"docs":{},"采":{"docs":{},"集":{"docs":{},"的":{"docs":{},"结":{"docs":{},"果":{"docs":{},"与":{"docs":{},"任":{"docs":{},"务":{"docs":{},"关":{"docs":{},"联":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"可":{"docs":{},"以":{"docs":{},"查":{"docs":{},"看":{"docs":{},"到":{"docs":{},"每":{"docs":{},"一":{"docs":{},"次":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"结":{"docs":{},"果":{"docs":{},"集":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"是":{"docs":{},"整":{"docs":{},"个":{"docs":{},"采":{"docs":{},"集":{"docs":{},"流":{"docs":{},"程":{"docs":{},"的":{"docs":{},"核":{"docs":{},"心":{"docs":{},",":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"的":{"docs":{},"过":{"docs":{},"程":{"docs":{},"都":{"docs":{},"是":{"docs":{},"跟":{"docs":{},"任":{"docs":{},"务":{"docs":{},"关":{"docs":{},"联":{"docs":{},"起":{"docs":{},"来":{"docs":{},"的":{"docs":{},",":{"docs":{},"因":{"docs":{},"此":{"docs":{},"任":{"docs":{},"务":{"docs":{},"对":{"docs":{},"于":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"来":{"docs":{},"说":{"docs":{},"非":{"docs":{},"常":{"docs":{},"重":{"docs":{},"要":{"docs":{},"。":{"docs":{},"任":{"docs":{},"务":{"docs":{},"被":{"docs":{},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},"触":{"docs":{},"发":{"docs":{},",":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"通":{"docs":{},"过":{"docs":{},"任":{"docs":{},"务":{"docs":{},"队":{"docs":{},"列":{"docs":{},"接":{"docs":{},"收":{"docs":{},"任":{"docs":{},"务":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"在":{"docs":{},"其":{"docs":{},"所":{"docs":{},"在":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},"执":{"docs":{},"行":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Task/":{"ref":"Usage/Task/","tf":0.16666666666666666}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"列":{"docs":{},"表":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}},"日":{"docs":{},"志":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}},"结":{"docs":{},"果":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}},"被":{"docs":{},"触":{"docs":{},"发":{"docs":{},"并":{"docs":{},"被":{"docs":{},"节":{"docs":{},"点":{"docs":{},"执":{"docs":{},"行":{"docs":{},"。":{"docs":{},"用":{"docs":{},"户":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"面":{"docs":{},"中":{"docs":{},"看":{"docs":{},"到":{"docs":{},"任":{"docs":{},"务":{"docs":{},"到":{"docs":{},"状":{"docs":{},"态":{"docs":{},"、":{"docs":{},"日":{"docs":{},"志":{"docs":{},"和":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"结":{"docs":{},"果":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"使":{"docs":{},"用":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{"Usage/":{"ref":"Usage/","tf":10}}}}}}}}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":10.071428571428571}},"触":{"docs":{},"发":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.18181818181818182}},"是":{"docs":{},"比":{"docs":{},"较":{"docs":{},"常":{"docs":{},"用":{"docs":{},"的":{"docs":{},"功":{"docs":{},"能":{"docs":{},",":{"docs":{},"对":{"docs":{},"于":{"docs":{},"增":{"docs":{},"量":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"或":{"docs":{},"对":{"docs":{},"实":{"docs":{},"时":{"docs":{},"性":{"docs":{},"有":{"docs":{},"要":{"docs":{},"求":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"很":{"docs":{},"重":{"docs":{},"要":{"docs":{},"。":{"docs":{},"这":{"docs":{},"在":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"中":{"docs":{},"会":{"docs":{},"详":{"docs":{},"细":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"。":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"列":{"docs":{},"表":{"docs":{},"会":{"docs":{},"进":{"docs":{},"行":{"docs":{},"更":{"docs":{},"新":{"docs":{},"。":{"docs":{},"每":{"docs":{},"一":{"docs":{},"次":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"更":{"docs":{},"新":{"docs":{},"、":{"docs":{},"删":{"docs":{},"除":{"docs":{},"、":{"docs":{},"创":{"docs":{},"建":{"docs":{},",":{"docs":{},"以":{"docs":{},"及":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"更":{"docs":{},"新":{"docs":{},"、":{"docs":{},"删":{"docs":{},"除":{"docs":{},"、":{"docs":{},"创":{"docs":{},"建":{"docs":{},",":{"docs":{},"都":{"docs":{},"会":{"docs":{},"触":{"docs":{},"发":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"列":{"docs":{},"表":{"docs":{},"的":{"docs":{},"更":{"docs":{},"新":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"是":{"docs":{},"指":{"docs":{},"定":{"docs":{},"某":{"docs":{},"个":{"docs":{},"时":{"docs":{},"刻":{"docs":{},",":{"docs":{},"重":{"docs":{},"复":{"docs":{},"性":{"docs":{},"地":{"docs":{},"执":{"docs":{},"行":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},",":{"docs":{},"英":{"docs":{},"文":{"docs":{},"叫":{"docs":{},"做":{"docs":{},"p":{"docs":{},"e":{"docs":{},"r":{"docs":{},"i":{"docs":{},"o":{"docs":{},"d":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Spider/":{"ref":"Usage/Spider/","tf":10.142857142857142},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"就":{"docs":{},"是":{"docs":{},"我":{"docs":{},"们":{"docs":{},"通":{"docs":{},"常":{"docs":{},"说":{"docs":{},"的":{"docs":{},"网":{"docs":{},"络":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},",":{"docs":{},"本":{"docs":{},"小":{"docs":{},"节":{"docs":{},"将":{"docs":{},"介":{"docs":{},"绍":{"docs":{},"如":{"docs":{},"下":{"docs":{},"内":{"docs":{},"容":{"docs":{},":":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}},"最":{"docs":{},"开":{"docs":{},"始":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"的":{"docs":{},"网":{"docs":{},"址":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}},"源":{"docs":{},"代":{"docs":{},"码":{"docs":{},"或":{"docs":{},"配":{"docs":{},"置":{"docs":{},"规":{"docs":{},"则":{"docs":{},"储":{"docs":{},"存":{"docs":{},"在":{"docs":{},"a":{"docs":{},"p":{"docs":{},"p":{"docs":{},"上":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"被":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"各":{"docs":{},"个":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"节":{"docs":{},"点":{"docs":{"Usage/":{"ref":"Usage/","tf":0.2},"Usage/Node/":{"ref":"Usage/Node/","tf":10.25},"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"中":{"docs":{},"的":{"docs":{},"w":{"docs":{},"o":{"docs":{},"r":{"docs":{},"k":{"docs":{},"e":{"docs":{},"r":{"docs":{},"。":{"docs":{},"一":{"docs":{},"个":{"docs":{},"节":{"docs":{},"点":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"会":{"docs":{},"连":{"docs":{},"接":{"docs":{},"到":{"docs":{},"一":{"docs":{},"个":{"docs":{},"任":{"docs":{},"务":{"docs":{},"队":{"docs":{},"列":{"docs":{},"(":{"docs":{},"例":{"docs":{},"如":{"docs":{},"r":{"docs":{},"e":{"docs":{},"d":{"docs":{},"i":{"docs":{},"s":{"docs":{},")":{"docs":{},"来":{"docs":{},"接":{"docs":{},"收":{"docs":{},"和":{"docs":{},"运":{"docs":{},"行":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"需":{"docs":{},"要":{"docs":{},"在":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"被":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"节":{"docs":{},"点":{"docs":{},"上":{"docs":{},",":{"docs":{},"用":{"docs":{},"户":{"docs":{},"在":{"docs":{},"部":{"docs":{},"署":{"docs":{},"前":{"docs":{},"需":{"docs":{},"要":{"docs":{},"定":{"docs":{},"义":{"docs":{},"节":{"docs":{},"点":{"docs":{},"的":{"docs":{},"i":{"docs":{},"p":{"docs":{},"地":{"docs":{},"址":{"docs":{},"和":{"docs":{},"端":{"docs":{},"口":{"docs":{},"(":{"docs":{},"默":{"docs":{},"认":{"docs":{},"为":{"docs":{},"l":{"docs":{},"o":{"docs":{},"c":{"docs":{},"a":{"docs":{},"l":{"docs":{},"h":{"docs":{},"o":{"docs":{},"s":{"docs":{},"t":{"docs":{},":":{"8":{"0":{"0":{"0":{"docs":{},")":{"docs":{},"。":{"docs":{"Usage/Node/":{"ref":"Usage/Node/","tf":0.25}}}}},"docs":{}},"docs":{}},"docs":{}},"docs":{}}}}}}}}}}}}}}},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"修":{"docs":{},"改":{"docs":{},"节":{"docs":{},"点":{"docs":{},"信":{"docs":{},"息":{"docs":{"Usage/Node/":{"ref":"Usage/Node/","tf":0.25},"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":10.25}}}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}},"点":{"docs":{},"击":{"docs":{},"侧":{"docs":{},"边":{"docs":{},"栏":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"节":{"docs":{},"点":{"docs":{},"列":{"docs":{},"表":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"已":{"docs":{},"上":{"docs":{},"线":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"。":{"docs":{},"这":{"docs":{},"里":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"其":{"docs":{},"实":{"docs":{},"就":{"docs":{},"是":{"docs":{},"已":{"docs":{},"经":{"docs":{},"运":{"docs":{},"行":{"docs":{},"起":{"docs":{},"来":{"docs":{},"的":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"i":{"docs":{"Usage/Node/View.html":{"ref":"Usage/Node/View.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"任":{"docs":{},"务":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"任":{"docs":{},"务":{"docs":{},"列":{"docs":{},"表":{"docs":{},"。":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"最":{"docs":{},"近":{"docs":{},"的":{"1":{"0":{"docs":{},"个":{"docs":{},"生":{"docs":{},"成":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{},"可":{"docs":{},"以":{"docs":{},"根":{"docs":{},"据":{"docs":{},"节":{"docs":{},"点":{"docs":{},"、":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"来":{"docs":{},"过":{"docs":{},"滤":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}},"docs":{}}}}}}}}}}}}}}}}}}}}}},"保":{"docs":{},"存":{"docs":{},"、":{"docs":{},"预":{"docs":{},"览":{"docs":{},",":{"docs":{},"查":{"docs":{},"看":{"docs":{},"预":{"docs":{},"览":{"docs":{},"内":{"docs":{},"容":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}},"配":{"docs":{},"置":{"docs":{},"标":{"docs":{},"签":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"配":{"docs":{},"置":{"docs":{},"页":{"docs":{},"面":{"docs":{},"。":{"docs":{},"接":{"docs":{},"下":{"docs":{},"来":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"对":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"规":{"docs":{},"则":{"docs":{},"进":{"docs":{},"行":{"docs":{},"配":{"docs":{},"置":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"的":{"docs":{},"查":{"docs":{},"看":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"进":{"docs":{},"入":{"docs":{},"到":{"docs":{},"该":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},"。":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}}}}}}}}}}}}}}}}}}}}},"日":{"docs":{},"志":{"docs":{},"标":{"docs":{},"签":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"查":{"docs":{},"看":{"docs":{},"任":{"docs":{},"务":{"docs":{},"日":{"docs":{},"志":{"docs":{},"。":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}}}}}}}}}}}}}},"结":{"docs":{},"果":{"docs":{},"标":{"docs":{},"签":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"查":{"docs":{},"看":{"docs":{},"任":{"docs":{},"务":{"docs":{},"结":{"docs":{},"果":{"docs":{},"。":{"docs":{"Usage/Task/View.html":{"ref":"Usage/Task/View.html","tf":0.125}}}}}}}}}}}}}}}},"添":{"docs":{},"加":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},",":{"docs":{},"弹":{"docs":{},"出":{"docs":{},"创":{"docs":{},"建":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"弹":{"docs":{},"框":{"docs":{},"。":{"docs":{},"填":{"docs":{},"写":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"内":{"docs":{},"容":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"提":{"docs":{},"交":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"创":{"docs":{},"建":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"在":{"docs":{},"右":{"docs":{},"侧":{"docs":{},"分":{"docs":{},"别":{"docs":{},"输":{"docs":{},"入":{"docs":{},"该":{"docs":{},"节":{"docs":{},"点":{"docs":{},"对":{"docs":{},"应":{"docs":{},"的":{"docs":{},"节":{"docs":{},"点":{"docs":{},"i":{"docs":{},"p":{"docs":{},"和":{"docs":{},"节":{"docs":{},"点":{"docs":{},"端":{"docs":{},"口":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"点":{"docs":{},"击":{"docs":{},"保":{"docs":{},"存":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"保":{"docs":{},"存":{"docs":{},"该":{"docs":{},"节":{"docs":{},"点":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{"Usage/Node/Edit.html":{"ref":"Usage/Node/Edit.html","tf":0.25}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"中":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"需":{"docs":{},"要":{"docs":{},"配":{"docs":{},"置":{"docs":{},"一":{"docs":{},"下":{"docs":{},"执":{"docs":{},"行":{"docs":{},"命":{"docs":{},"令":{"docs":{},"(":{"docs":{},"运":{"docs":{},"行":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"时":{"docs":{},"后":{"docs":{},"台":{"docs":{},"执":{"docs":{},"行":{"docs":{},"的":{"docs":{},"s":{"docs":{},"h":{"docs":{},"e":{"docs":{},"l":{"docs":{},"l":{"docs":{},"命":{"docs":{},"令":{"docs":{},")":{"docs":{},"和":{"docs":{},"结":{"docs":{},"果":{"docs":{},"集":{"docs":{},"(":{"docs":{},"通":{"docs":{},"过":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"l":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"传":{"docs":{},"递":{"docs":{},"给":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"程":{"docs":{},"序":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"程":{"docs":{},"序":{"docs":{},"存":{"docs":{},"储":{"docs":{},"结":{"docs":{},"果":{"docs":{},"的":{"docs":{},"地":{"docs":{},"方":{"docs":{},")":{"docs":{},",":{"docs":{},"然":{"docs":{},"后":{"docs":{},"点":{"docs":{},"击":{"docs":{},"保":{"docs":{},"存":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"保":{"docs":{},"存":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"上":{"docs":{},"传":{"docs":{},"之":{"docs":{},"前":{"docs":{},",":{"docs":{},"需":{"docs":{},"要":{"docs":{},"将":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"文":{"docs":{},"件":{"docs":{},"打":{"docs":{},"包":{"docs":{},"成":{"docs":{},"z":{"docs":{},"i":{"docs":{},"p":{"docs":{},"格":{"docs":{},"式":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"侧":{"docs":{},"边":{"docs":{},"栏":{"docs":{},"点":{"docs":{},"击":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"添":{"docs":{},"加":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}},"检":{"docs":{},"查":{"docs":{},"完":{"docs":{},"目":{"docs":{},"标":{"docs":{},"网":{"docs":{},"页":{"docs":{},"的":{"docs":{},"元":{"docs":{},"素":{"docs":{},"c":{"docs":{},"s":{"docs":{},"s":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"输":{"docs":{},"入":{"docs":{},"列":{"docs":{},"表":{"docs":{},"项":{"docs":{},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{},"、":{"docs":{},"开":{"docs":{},"始":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"、":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},"/":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"等":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{},"注":{"docs":{},"意":{"docs":{},"勾":{"docs":{},"选":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"为":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"爬":{"docs":{},"虫":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},"点":{"docs":{},"击":{"docs":{},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"的":{"docs":{},"部":{"docs":{},"署":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"将":{"docs":{},"指":{"docs":{},"定":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"所":{"docs":{},"有":{"docs":{},"在":{"docs":{},"线":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},";":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}},"部":{"docs":{},"署":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"将":{"docs":{},"所":{"docs":{},"有":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"所":{"docs":{},"有":{"docs":{},"在":{"docs":{},"线":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},";":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"点":{"docs":{},"击":{"docs":{},"运":{"docs":{},"行":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"或":{"docs":{},"者":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}},"详":{"docs":{},"情":{"docs":{},"的":{"docs":{},"概":{"docs":{},"览":{"docs":{},"标":{"docs":{},"签":{"docs":{},"中":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"部":{"docs":{},"署":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"将":{"docs":{},"指":{"docs":{},"定":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"部":{"docs":{},"署":{"docs":{},"到":{"docs":{},"所":{"docs":{},"有":{"docs":{},"在":{"docs":{},"线":{"docs":{},"节":{"docs":{},"点":{"docs":{},"中":{"docs":{},"。":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"中":{"docs":{},"概":{"docs":{},"览":{"docs":{},"标":{"docs":{},"签":{"docs":{},"下":{"docs":{},"点":{"docs":{},"击":{"docs":{},"运":{"docs":{},"行":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"或":{"docs":{},"者":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.09090909090909091}}}}}}}}}}}}}}}}}}}}},"运":{"docs":{},"行":{"docs":{},"了":{"docs":{},"一":{"docs":{},"段":{"docs":{},"时":{"docs":{},"间":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"会":{"docs":{},"积":{"docs":{},"累":{"docs":{},"一":{"docs":{},"些":{"docs":{},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{},",":{"docs":{},"例":{"docs":{},"如":{"docs":{},"运":{"docs":{},"行":{"docs":{},"成":{"docs":{},"功":{"docs":{},"率":{"docs":{},"、":{"docs":{},"任":{"docs":{},"务":{"docs":{},"数":{"docs":{},"、":{"docs":{},"运":{"docs":{},"行":{"docs":{},"时":{"docs":{},"长":{"docs":{},"等":{"docs":{},"指":{"docs":{},"标":{"docs":{},"。":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"将":{"docs":{},"这":{"docs":{},"些":{"docs":{},"指":{"docs":{},"标":{"docs":{},"汇":{"docs":{},"总":{"docs":{},"并":{"docs":{},"呈":{"docs":{},"现":{"docs":{},"给":{"docs":{},"开":{"docs":{},"发":{"docs":{},"者":{"docs":{},"。":{"docs":{"Usage/Spider/Analytics.html":{"ref":"Usage/Spider/Analytics.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"任":{"docs":{},"务":{"docs":{},"列":{"docs":{},"表":{"docs":{},"中":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"中":{"docs":{},"的":{"docs":{},"删":{"docs":{},"除":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"确":{"docs":{},"认":{"docs":{},"删":{"docs":{},"除":{"docs":{},"该":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":0.16666666666666666}}}}}}}}}}}}}}}}}}}}}}}}}}}},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"中":{"docs":{},",":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"是":{"docs":{},"通":{"docs":{},"过":{"docs":{},"a":{"docs":{},"p":{"docs":{},"s":{"docs":{},"c":{"docs":{},"h":{"docs":{},"e":{"docs":{},"d":{"docs":{},"u":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"来":{"docs":{},"实":{"docs":{},"现":{"docs":{},"的":{"docs":{},"。":{"docs":{},"创":{"docs":{},"建":{"docs":{},"一":{"docs":{},"个":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"会":{"docs":{},"在":{"docs":{},"名":{"docs":{},"为":{"docs":{},"m":{"docs":{},"o":{"docs":{},"n":{"docs":{},"g":{"docs":{},"o":{"docs":{},"的":{"docs":{},"j":{"docs":{},"o":{"docs":{},"b":{"docs":{},"s":{"docs":{},"t":{"docs":{},"o":{"docs":{},"r":{"docs":{},"e":{"docs":{},"中":{"docs":{},"创":{"docs":{},"建":{"docs":{},"一":{"docs":{},"个":{"docs":{},"p":{"docs":{},"e":{"docs":{},"r":{"docs":{},"i":{"docs":{},"o":{"docs":{},"d":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"创":{"docs":{},"建":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":10.2}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2},"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":10.03225806451613}},"是":{"docs":{},"版":{"docs":{},"本":{"docs":{},"v":{"0":{"docs":{},".":{"2":{"docs":{},".":{"1":{"docs":{},"开":{"docs":{},"发":{"docs":{},"的":{"docs":{},"功":{"docs":{},"能":{"docs":{},"。":{"docs":{},"目":{"docs":{},"的":{"docs":{},"是":{"docs":{},"将":{"docs":{},"具":{"docs":{},"有":{"docs":{},"相":{"docs":{},"似":{"docs":{},"网":{"docs":{},"站":{"docs":{},"结":{"docs":{},"构":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"项":{"docs":{},"目":{"docs":{},"可":{"docs":{},"配":{"docs":{},"置":{"docs":{},"化":{"docs":{},",":{"docs":{},"将":{"docs":{},"开":{"docs":{},"发":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"过":{"docs":{},"程":{"docs":{},"流":{"docs":{},"程":{"docs":{},"化":{"docs":{},",":{"docs":{},"大":{"docs":{},"大":{"docs":{},"提":{"docs":{},"高":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"开":{"docs":{},"发":{"docs":{},"效":{"docs":{},"率":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"docs":{}}},"docs":{}}},"docs":{}}}}}}}}}},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Analytics.html":{"ref":"Usage/Spider/Analytics.html","tf":10.333333333333334}}}}}},"部":{"docs":{},"署":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/":{"ref":"Usage/Spider/","tf":0.14285714285714285},"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":10.142857142857142}},"很":{"docs":{},"简":{"docs":{},"单":{"docs":{},",":{"docs":{},"有":{"docs":{},"三":{"docs":{},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}},"好":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"运":{"docs":{},"行":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/Deploy.html":{"ref":"Usage/Spider/Deploy.html","tf":0.14285714285714285}}}}}}}}}}}}}}}}}}},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/Create.html":{"ref":"Usage/Spider/Create.html","tf":0.2},"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":10.066666666666666}},"是":{"docs":{},"指":{"docs":{},"用":{"docs":{},"户":{"docs":{},"可":{"docs":{},"以":{"docs":{},"添":{"docs":{},"加":{"docs":{},"的":{"docs":{},"任":{"docs":{},"何":{"docs":{},"语":{"docs":{},"言":{"docs":{},"任":{"docs":{},"何":{"docs":{},"框":{"docs":{},"架":{"docs":{},"的":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},",":{"docs":{},"高":{"docs":{},"度":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"化":{"docs":{},"。":{"docs":{},"当":{"docs":{},"用":{"docs":{},"户":{"docs":{},"添":{"docs":{},"加":{"docs":{},"好":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"将":{"docs":{},"其":{"docs":{},"集":{"docs":{},"成":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"管":{"docs":{},"理":{"docs":{},"的":{"docs":{},"系":{"docs":{},"统":{"docs":{},"中":{"docs":{},"来":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"的":{"docs":{},"添":{"docs":{},"加":{"docs":{},"有":{"docs":{},"两":{"docs":{},"种":{"docs":{},"方":{"docs":{},"式":{"docs":{},":":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}},"接":{"docs":{},"下":{"docs":{},"来":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"部":{"docs":{},"署":{"docs":{},"、":{"docs":{},"运":{"docs":{},"行":{"docs":{},"自":{"docs":{},"定":{"docs":{},"义":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}}}}}}}}}}}}}},"通":{"docs":{},"过":{"docs":{},"w":{"docs":{},"e":{"docs":{},"b":{"docs":{},"界":{"docs":{},"面":{"docs":{},"上":{"docs":{},"传":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}},"爬":{"docs":{},"虫":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}}},"创":{"docs":{},"建":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}},"添":{"docs":{},"加":{"docs":{},"项":{"docs":{},"目":{"docs":{},"目":{"docs":{},"录":{"docs":{"Usage/Spider/CustomizedSpider.html":{"ref":"Usage/Spider/CustomizedSpider.html","tf":0.06666666666666667}}}}}}}}}},"&":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.06451612903225806}}},"仅":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},"。":{"docs":{},"这":{"docs":{},"也":{"docs":{},"是":{"docs":{},"最":{"docs":{},"简":{"docs":{},"单":{"docs":{},"的":{"docs":{},"形":{"docs":{},"式":{"docs":{},",":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"列":{"docs":{},"表":{"docs":{},"上":{"docs":{},"的":{"docs":{},"列":{"docs":{},"表":{"docs":{},"项":{"docs":{},",":{"docs":{},"将":{"docs":{},"数":{"docs":{},"据":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"下":{"docs":{},"来":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"只":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}},"列":{"docs":{},"表":{"docs":{},"+":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"先":{"docs":{},"遍":{"docs":{},"历":{"docs":{},"列":{"docs":{},"表":{"docs":{},"页":{"docs":{},",":{"docs":{},"将":{"docs":{},"列":{"docs":{},"表":{"docs":{},"项":{"docs":{},"中":{"docs":{},"的":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"地":{"docs":{},"址":{"docs":{},"提":{"docs":{},"取":{"docs":{},"出":{"docs":{},"来":{"docs":{},"并":{"docs":{},"跟":{"docs":{},"进":{"docs":{},"抓":{"docs":{},"取":{"docs":{},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"页":{"docs":{},"字":{"docs":{},"段":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}},"项":{"docs":{},"的":{"docs":{},"匹":{"docs":{},"和":{"docs":{},"分":{"docs":{},"页":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"的":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"查":{"docs":{},"询":{"docs":{},",":{"docs":{},"由":{"docs":{},"c":{"docs":{},"s":{"docs":{},"s":{"docs":{},"或":{"docs":{},"x":{"docs":{},"p":{"docs":{},"a":{"docs":{},"t":{"docs":{},"h":{"docs":{},"来":{"docs":{},"进":{"docs":{},"行":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"选":{"docs":{},"择":{"docs":{},"器":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}},"开":{"docs":{},"始":{"docs":{},"u":{"docs":{},"r":{"docs":{},"l":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}},"抓":{"docs":{},"取":{"docs":{},"类":{"docs":{},"别":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}},"详":{"docs":{},"情":{"docs":{},"页":{"docs":{},"字":{"docs":{},"段":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}},"输":{"docs":{},"入":{"docs":{},"完":{"docs":{},"基":{"docs":{},"本":{"docs":{},"信":{"docs":{},"息":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"添":{"docs":{},"加":{"docs":{},"。":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}}}}},"遵":{"docs":{},"守":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},"协":{"docs":{},"议":{"docs":{"Usage/Spider/ConfigurableSpider.html":{"ref":"Usage/Spider/ConfigurableSpider.html","tf":0.03225806451612903}}}}}}}}}}}},"手":{"docs":{},"动":{"docs":{},"触":{"docs":{},"发":{"docs":{"Usage/Spider/Run.html":{"ref":"Usage/Spider/Run.html","tf":0.18181818181818182}}}}}},"要":{"docs":{},"查":{"docs":{},"看":{"docs":{},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{},"的":{"docs":{},"话":{"docs":{},",":{"docs":{},"只":{"docs":{},"需":{"docs":{},"要":{"docs":{},"在":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"详":{"docs":{},"情":{"docs":{},"中":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"分":{"docs":{},"析":{"docs":{},"标":{"docs":{},"签":{"docs":{},",":{"docs":{},"就":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"爬":{"docs":{},"虫":{"docs":{},"的":{"docs":{},"统":{"docs":{},"计":{"docs":{},"数":{"docs":{},"据":{"docs":{},"了":{"docs":{},"。":{"docs":{"Usage/Spider/Analytics.html":{"ref":"Usage/Spider/Analytics.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"操":{"docs":{},"作":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Task/":{"ref":"Usage/Task/","tf":0.16666666666666666},"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":10.166666666666666}}}}}},"停":{"docs":{},"止":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":0.16666666666666666}}}}}},"删":{"docs":{},"除":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":0.16666666666666666}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}},"导":{"docs":{},"航":{"docs":{},"至":{"docs":{},"需":{"docs":{},"要":{"docs":{},"停":{"docs":{},"止":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"停":{"docs":{},"止":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"来":{"docs":{},"终":{"docs":{},"止":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Task/Action.html":{"ref":"Usage/Task/Action.html","tf":0.16666666666666666}}}}}}}}}}}}}}}}}}}}}}}}}}},"任":{"docs":{},"务":{"docs":{},"详":{"docs":{},"情":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"结":{"docs":{},"果":{"docs":{},"标":{"docs":{},"签":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"下":{"docs":{},"载":{"docs":{},"c":{"docs":{},"s":{"docs":{},"v":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"等":{"docs":{},"待":{"docs":{},"一":{"docs":{},"会":{"docs":{},"儿":{"docs":{},",":{"docs":{},"结":{"docs":{},"果":{"docs":{},"就":{"docs":{},"会":{"docs":{},"以":{"docs":{},"c":{"docs":{},"s":{"docs":{},"v":{"docs":{},"的":{"docs":{},"形":{"docs":{},"式":{"docs":{},"下":{"docs":{},"载":{"docs":{},"到":{"docs":{},"本":{"docs":{},"地":{"docs":{},"。":{"docs":{"Usage/Task/DownloadResults.html":{"ref":"Usage/Task/DownloadResults.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"页":{"docs":{},"面":{"docs":{},",":{"docs":{},"可":{"docs":{},"以":{"docs":{},"看":{"docs":{},"到":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"列":{"docs":{},"表":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}},"点":{"docs":{},"击":{"docs":{},"操":{"docs":{},"作":{"docs":{},"列":{"docs":{},"的":{"docs":{},"修":{"docs":{},"改":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"弹":{"docs":{},"出":{"docs":{},"修":{"docs":{},"改":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"弹":{"docs":{},"框":{"docs":{},"。":{"docs":{},"填":{"docs":{},"写":{"docs":{},"相":{"docs":{},"应":{"docs":{},"的":{"docs":{},"内":{"docs":{},"容":{"docs":{},",":{"docs":{},"点":{"docs":{},"击":{"docs":{},"提":{"docs":{},"交":{"docs":{},"按":{"docs":{},"钮":{"docs":{},"修":{"docs":{},"改":{"docs":{},"定":{"docs":{},"时":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"删":{"docs":{},"除":{"docs":{},"按":{"docs":{},"钮":{"docs":{},",":{"docs":{},"确":{"docs":{},"认":{"docs":{},"删":{"docs":{},"除":{"docs":{},"该":{"docs":{},"任":{"docs":{},"务":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"结":{"docs":{},"果":{"docs":{},"储":{"docs":{},"存":{"docs":{},"在":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"中":{"docs":{},"之":{"docs":{},"后":{"docs":{},",":{"docs":{},"我":{"docs":{},"们":{"docs":{},"有":{"docs":{},"时":{"docs":{},"候":{"docs":{},"需":{"docs":{},"要":{"docs":{},"将":{"docs":{},"其":{"docs":{},"导":{"docs":{},"出":{"docs":{},",":{"docs":{},"这":{"docs":{},"时":{"docs":{},"可":{"docs":{},"以":{"docs":{},"在":{"docs":{},"界":{"docs":{},"面":{"docs":{},"中":{"docs":{},"进":{"docs":{},"行":{"docs":{},"导":{"docs":{},"出":{"docs":{},"操":{"docs":{},"作":{"docs":{},"。":{"docs":{"Usage/Task/DownloadResults.html":{"ref":"Usage/Task/DownloadResults.html","tf":0.3333333333333333}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"j":{"docs":{},"o":{"docs":{},"b":{"docs":{},",":{"docs":{},"a":{"docs":{},"p":{"docs":{},"s":{"docs":{},"c":{"docs":{},"h":{"docs":{},"e":{"docs":{},"d":{"docs":{},"u":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"调":{"docs":{},"度":{"docs":{},"引":{"docs":{},"擎":{"docs":{},"将":{"docs":{},"会":{"docs":{},"不":{"docs":{},"断":{"docs":{},"的":{"docs":{},"去":{"docs":{},"数":{"docs":{},"据":{"docs":{},"库":{"docs":{},"中":{"docs":{},"匹":{"docs":{},"配":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"执":{"docs":{},"行":{"docs":{},"时":{"docs":{},"间":{"docs":{},",":{"docs":{},"如":{"docs":{},"果":{"docs":{},"执":{"docs":{},"行":{"docs":{},"时":{"docs":{},"间":{"docs":{},"满":{"docs":{},"足":{"docs":{},"要":{"docs":{},"求":{"docs":{},",":{"docs":{},"则":{"docs":{},"会":{"docs":{},"在":{"docs":{},"后":{"docs":{},"台":{"docs":{},"触":{"docs":{},"发":{"docs":{},"一":{"docs":{},"次":{"docs":{},"任":{"docs":{},"务":{"docs":{},"运":{"docs":{},"行":{"docs":{},"。":{"docs":{"Usage/Schedule/":{"ref":"Usage/Schedule/","tf":0.07142857142857142}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"u":{"docs":{},"e":{"docs":{},"j":{"docs":{},"i":{"docs":{},"n":{"docs":{},"p":{"docs":{},"i":{"docs":{},"p":{"docs":{},"e":{"docs":{},"l":{"docs":{},"i":{"docs":{},"n":{"docs":{},"e":{"docs":{},"(":{"docs":{},"o":{"docs":{},"b":{"docs":{},"j":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},")":{"docs":{},":":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}}}}}}},"网":{"docs":{},"站":{"docs":{"Usage/Site/":{"ref":"Usage/Site/","tf":10.5}},"信":{"docs":{},"息":{"docs":{},"是":{"docs":{},"帮":{"docs":{},"助":{"docs":{},"用":{"docs":{},"户":{"docs":{},"查":{"docs":{},"看":{"docs":{},"站":{"docs":{},"长":{"docs":{},"之":{"docs":{},"家":{"docs":{},"收":{"docs":{},"录":{"docs":{},"网":{"docs":{},"站":{"docs":{},"的":{"docs":{},"信":{"docs":{},"息":{"docs":{},"的":{"docs":{},",":{"docs":{},"包":{"docs":{},"含":{"docs":{},"r":{"docs":{},"o":{"docs":{},"b":{"docs":{},"o":{"docs":{},"t":{"docs":{},"s":{"docs":{},"协":{"docs":{},"议":{"docs":{},"、":{"docs":{},"首":{"docs":{},"页":{"docs":{},"响":{"docs":{},"应":{"docs":{},"等":{"docs":{},"信":{"docs":{},"息":{"docs":{},"。":{"docs":{"Usage/Site/":{"ref":"Usage/Site/","tf":0.5}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"一":{"docs":{},"个":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"的":{"docs":{},"插":{"docs":{},"件":{"docs":{},",":{"docs":{},"用":{"docs":{},"于":{"docs":{},"监":{"docs":{},"控":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"节":{"docs":{},"点":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}},"中":{"docs":{},"间":{"docs":{},"者":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}},"跟":{"docs":{},"c":{"docs":{},"e":{"docs":{},"l":{"docs":{},"e":{"docs":{},"r":{"docs":{},"y":{"docs":{},"中":{"docs":{},"定":{"docs":{},"义":{"docs":{},"的":{"docs":{},"一":{"docs":{},"样":{"docs":{},",":{"docs":{},"作":{"docs":{},"为":{"docs":{},"运":{"docs":{},"行":{"docs":{},"异":{"docs":{},"步":{"docs":{},"任":{"docs":{},"务":{"docs":{},"的":{"docs":{},"队":{"docs":{},"列":{"docs":{},"。":{"docs":{"Architecture/":{"ref":"Architecture/","tf":0.037037037037037035}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"架":{"docs":{},"构":{"docs":{"Architecture/":{"ref":"Architecture/","tf":10.037037037037036}}}},"与":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"集":{"docs":{},"成":{"docs":{"Examples/":{"ref":"Examples/","tf":0.5},"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":10.020408163265307}}}}}}}}}}},"样":{"docs":{},"例":{"docs":{"Examples/":{"ref":"Examples/","tf":10.5}}}},"=":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.1836734693877551}}},"o":{"docs":{},"s":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}},".":{"docs":{},"e":{"docs":{},"n":{"docs":{},"v":{"docs":{},"i":{"docs":{},"r":{"docs":{},"o":{"docs":{},"n":{"docs":{},".":{"docs":{},"g":{"docs":{},"e":{"docs":{},"t":{"docs":{},"(":{"docs":{},"'":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"_":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"l":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"'":{"docs":{},")":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"'":{"docs":{},")":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"以":{"docs":{},"下":{"docs":{},"是":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"跟":{"docs":{},"s":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"p":{"docs":{},"y":{"docs":{},"集":{"docs":{},"成":{"docs":{},"的":{"docs":{},"例":{"docs":{},"子":{"docs":{},",":{"docs":{},"利":{"docs":{},"用":{"docs":{},"了":{"docs":{},"c":{"docs":{},"r":{"docs":{},"a":{"docs":{},"w":{"docs":{},"l":{"docs":{},"a":{"docs":{},"b":{"docs":{},"传":{"docs":{},"过":{"docs":{},"来":{"docs":{},"的":{"docs":{},"t":{"docs":{},"a":{"docs":{},"s":{"docs":{},"k":{"docs":{},"_":{"docs":{},"i":{"docs":{},"d":{"docs":{},"和":{"docs":{},"c":{"docs":{},"o":{"docs":{},"l":{"docs":{},"l":{"docs":{},"e":{"docs":{},"c":{"docs":{},"t":{"docs":{},"i":{"docs":{},"o":{"docs":{},"n":{"docs":{},"_":{"docs":{},"n":{"docs":{},"a":{"docs":{},"m":{"docs":{},"e":{"docs":{},"。":{"docs":{"Examples/ScrapyIntegration.html":{"ref":"Examples/ScrapyIntegration.html","tf":0.02040816326530612}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}},"length":384},"corpusTokens":["\"27017:27017\"","\"6379:6379\"","\"8000:8000\"","\"8001:8000\"","\"8002:8000\"","\"8080:8080\"","\"registri","#","&","'192.168.99.100'","'3.3'","'crawlab_test'","'test'","../crawlab","../frontend","/bin/sh","/home/yeqing/.env.production.master:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.product","/home/yeqing/.env.production:/opt/crawlab/frontend/.env.product","/home/yeqing/config.master.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.pi","/home/yeqing/jenkins_home/workspace/crawlab_develop/frontend/dist;","/opt/crawlab/docker_init.sh","16.04是以下命令。","27017","27017:27017","30秒的时间来build前端静态文件,之后就可以打开crawlab界面地址地址看到界面了。界面地址默认为http://localhost:8080。","8000:8000","8080:8080","8080;","=","[\"https://registry.dock","[app]","\\","admin的单页应用。其中重用了很多el","alway","api服务","app","app.pi","app.py来启动应用。","apt","backend","broker","build:prod","cd","class","clone","cn.com\"]","col","col_nam","col_name:","compos","compose.yml后,只需要运行以下命令就可以启动crawlab。","compose.yml定义如下。","compose.yml更改为如下内容。","compose.yml的yaml文件来定义需要启动的容器,可以是单个,也可以(通常)是多个的。crawlab的dock","compose也很简单,大家去网上百度一下就可以了。","compose和定义好dock","compose是一个集群管理方式,可以利用名为dock","compose的方式很适合多节点部署,在原有的master基础上增加几个worker节点,达到多节点部署的目的。将dock","compose的方式来部署。dock","container_name:","crawlab","crawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。","crawlab会自动发现project_source_file_folder目录下的所有爬虫目录,并将这些目录生成自定义爬虫并集成到crawlab中。因此,将爬虫项目目录拷贝到project_source_file_folder目录下,就可以添加一个爬虫了。","crawlab允许用户创建两种爬虫:","crawlab是基于celery的分布式爬虫管理平台,可以集成任何语言和任何框架。","crawlab的可配置爬虫是基于scrapy的,因此天生支持并发。而且,可配置爬虫完全支持自定义爬虫的一般功能,因此也支持任务调度、任务监控、日志监控、数据分析。","crawlab的架构跟celery非常相似,但是加入了包括前端、爬虫、flower在内的额外模块,以支持爬虫管理的功能。架构图如下。","crawlab简介","d","db","db[col_name]","def","demo","depends_on:","dev.crawlab.com;","docker","docker安装部署","element","entrypoint:","exampl","flower","flower.pi","frontend","g","git","https://github.com/tikazyq/crawlab","image:","import","index","index.html;","instal","item","item,","item['task_id']","job,apscheduler调度引擎将会不断的去数据库中匹配任务的执行时间,如果执行时间满足要求,则会在后台触发一次任务运行。","juejinpipeline(object):","listen","log","manage.pi","master","master:","mirrors\":","mongo","mongo:","mongo:latest","mongo[mongo_db]","mongo_db","mongo_host","mongo_port","mongocli","mongoclient(host=mongo_host,","mongo一行命令。如何安装docker跟操作系统有关,这里就不展开讲了,需要的同学自行百度一下相关教程。","name","nginx","node","npm","os","os.environ.get('crawlab_collection')","os.environ.get('crawlab_task_id')","p","pip","pipelin","pm2","port=mongo_port)","ports:","process_item(self,","pull","pymongo","python","r","redi","redis:","redis:latest","reload","requir","restart:","return","rm","root","run","scrapi","self.col.save(item)","serv","server","server_nam","serve来进行的,因此是开发者模式。注意:强烈不建议在生产环境中用预览模式。预览模式只是让开发者快速体验crawlab以及调试代码问题的一种方式,而不是用作生产环境部署的。","services:","spider","spider):","start","sudo","task","tasks,在linux中也被称为crontab。定时任务可以让任务可以被执行多次,而用户则不用手动的操作来执行任务。在生产环境中,这非常常见。定时任务对于对增量抓取或对数据实时性有要求的用户来说非常有用。","tikazyq/crawlab","tikazyq/crawlab:latest","ui的控件来支持相应的展示。","up","v","version:","volumns:","worker","worker.pi","worker1:","worker2:","worker,他们通过连接到配置好的broker(通常是redis)来进行与主机的通信。","yarn","{","}","一个celery的插件,用于监控celery节点。","下载结果","下载镜像","与scrapy集成","中间者","中间者跟celery中定义的一样,作为运行异步任务的队列。","仅列表页。这也是最简单的形式,爬虫遍历列表上的列表项,将数据抓取下来。","仅详情页。爬虫只抓取详情页。","以下是crawlab跟scrapy集成的例子,利用了crawlab传过来的task_id和collection_name。","任务","任务其实就是指某一次抓取任务或采集任务。任务与爬虫关联,其执行的也是爬虫指定的执行命令或采集规则。抓取或采集的结果与任务关联,因此可以查看到每一次任务的结果集。crawlab的任务是整个采集流程的核心,抓取的过程都是跟任务关联起来的,因此任务对于crawlab来说非常重要。任务被app触发,worker通过任务队列接收任务,然后在其所在节点上执行任务。","任务列表","任务日志","任务结果","任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。","使用crawlab","修改定时任务","修改节点信息","停止任务","其中,root是静态文件的根目录,这里是npm打包好后的静态文件。","其中,我们映射了8080端口(nginx前端静态文件)以及8000端口(后端api)到宿主机。另外还将前端配置文件/home/yeqing/.env.production和后端配置文件/home/yeqing/config.py映射到了容器相应的目录下。传入参数master是代表该启动方式为主机启动模式,也就是所有服务(前端、api、flower、worker)都会启动。另外一个模式是worker模式,只会启动必要的api和worker服务,这个对于分布式部署比较有用。等待大约20","分别配置前端配置文件./frontend/.env.production和后端配置文件./crawlab/config/config.py。分别需要对部署后api地址以及数据库地址进行配置。","分页选择器","列表+详情页。爬虫先遍历列表页,将列表项中的详情页地址提取出来并跟进抓取详情页。","列表页字段","列表项的匹和分页按钮的匹配查询,由css或xpath来进行匹配。","列表项选择器","创建定时任务","创建爬虫","删除任务","删除定时任务","前端","前端其实就是一个基于vue","前端配置文件","前者可以通过web界面和创建项目目录的方式来添加,后者由于没有源代码,只能通过web界面来添加。","可配置爬虫","可配置爬虫是版本v0.2.1开发的功能。目的是将具有相似网站结构的爬虫项目可配置化,将开发爬虫的过程流程化,大大提高爬虫开发效率。","同样,在浏览器中输入http://localhost:8080就可以看到界面。","后台应用","后端配置文件","后面我们需要让爬虫运行在各个节点上,需要让主机与节点进行通信,因此需要知道节点的ip地址和端口。我们需要手动配置一下节点的ip和端口。在节点列表中点击操作列里的蓝色查看按钮进入到节点详情。节点详情样子如下。","启动服务","在crawlab中,定时任务是通过apscheduler来实现的。创建一个定时任务之后,会在名为mongo的jobstore中创建一个period","在任务列表中,点击操作列中的删除按钮,确认删除该任务。","在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮。","在右侧分别输入该节点对应的节点ip和节点端口,然后点击保存按钮,保存该节点信息。","在定义爬虫中,我们需要配置一下执行命令(运行爬虫时后台执行的shell命令)和结果集(通过crawlab_collection传递给爬虫程序,爬虫程序存储结果的地方),然后点击保存按钮保存爬虫信息。","在检查完目标网页的元素css选择器之后,我们输入列表项选择器、开始url、列表页/详情页等信息。注意勾选url为详情页url。","在爬虫列表中操作列点击运行按钮,或者","在爬虫列表中点击操作列的部署按钮,将指定爬虫部署到所有在线节点中;","在爬虫列表中点击部署所有爬虫,将所有爬虫部署到所有在线节点中;","在爬虫详情中概览标签下点击运行按钮,或者","在爬虫详情的概览标签中,点击部署按钮,将指定爬虫部署到所有在线节点中。","在运行了一段时间之后,爬虫会积累一些统计数据,例如运行成功率、任务数、运行时长等指标。crawlab将这些指标汇总并呈现给开发者。","在通过web界面上传之前,需要将爬虫项目文件打包成zip格式。","基于celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.","多节点模式","安装","安装crawlab","安装docker","安装nginx,在ubuntu","安装前端所需库。","安装后端所需库。","安装完docker","定时任务","定时任务列表会进行更新。每一次爬虫更新、删除、创建,以及定时任务的更新、删除、创建,都会触发定时任务列表的更新。","定时任务是指定某个时刻,重复性地执行的任务,英文叫做period","定时任务触发","定时任务触发是比较常用的功能,对于增量抓取或对实时性有要求的任务很重要。这在定时任务中会详细介绍。","对docker不了解的开发者,可以参考一下这篇文章(9102","对于自定义爬虫,可以在配置标签下点击运行按钮","导航至任务详情,点击结果标签,点击下载csv按钮,等待一会儿,结果就会以csv的形式下载到本地。","导航至定时任务页面,可以看到定时任务的列表。","导航至定时任务页面,点击操作列的修改按钮,弹出修改定时任务的弹框。填写相应的内容,点击提交按钮修改定时任务。","导航至定时任务页面,点击操作列的删除按钮,确认删除该任务。","导航至需要停止的任务的任务详情,点击停止按钮来终止任务。","年了,学点","开始url","当任务运行起来之后,我们因为某个原因可能需要终止任务,这时我们需要在crawlab中停止该任务。","当然,也可以用docker","我们已经在dockerhub上构建了crawlab的镜像,开发者只需要将其pull下来使用。在pul","我们有两种运行爬虫的方式:","手动触发","执行以下命令将crawlab的镜像下载下来。镜像大小大概在几百兆,因此下载需要几分钟时间。","抓取类别","拉取代码","拷贝一份后端配置文件./crawlab/config/config.py以及前端配置文件./frontend/.env.production到某一个地方。例如我的例子,分别为/home/yeqing/config.py和/home/yeqing/.env.production。","接下来,我们就可以部署、运行自定义爬虫了。","操作任务","更改后端配置文件config.py,将mongodb、redis的指向ip更改为自己数据的值。注意,容器中对应的宿主机的ip地址不是localhost,而是172.17.0.1(当然也可以用network来做,只是稍微麻烦一些)。更改前端配置文件.env.production,将api地址vue_app_base_url更改为宿主机所在的ip地址,例如http://192.168.0.8:8000,这将是前端调用api会用到的url。","更改好配置文件之后,接下来就是运行容器了。执行以下命令来启动容器。","更改配置文件","本使用手册会帮助您解决在安装使用crawlab遇到的任何问题。","本小节将介绍三种安装docker的方式:","本小节将介绍以下内容:","本小节将介绍如何使用crawlab,包括如下内容:","构建","构建完成后,会在./frontend目录下创建一个dist文件夹,里面是打包好后的静态文件。","架构","查看任务","查看演示","查看节点","查看节点列表","样例","添加/etc/nginx/conf.d/crawlab.conf文件,输入以下内容。","添加完成后,可以看到刚刚添加的可配置爬虫出现了在最下方,点击查看进入到爬虫详情。","添加爬虫","点击侧边栏的任务导航至任务列表。可以看到最近的10个生成的任务。可以根据节点、爬虫来过滤任务。","点击侧边栏的节点导航至节点列表,可以看到已上线的节点。这里的节点其实就是已经运行起来的celeri","点击保存、预览,查看预览内容。","点击可配置爬虫。","点击操作列的查看按钮,进入到该任务的任务详情。","点击日志标签,可以查看任务日志。","点击添加定时任务,弹出创建定时任务的弹框。填写相应的内容,点击提交按钮创建定时任务。","点击结果标签,可以查看任务结果。","点击配置标签进入到配置页面。接下来,我们需要对爬虫规则进行配置。","然后在浏览器中输入http://localhost:8080就可以看到界面了。","然后,crawlab会提示任务已经派发到队列中去了,然后你可以在爬虫详情左侧看到新创建的任务。点击创建时间可以导航至任务详情。","然后,在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮,选择自定义爬虫,点击上传按钮,选择刚刚打包好的zip文件。上传成功后,爬虫列表中会出现新添加的自定义爬虫。这样就算添加好了。","爬虫","爬虫就是我们通常说的网络爬虫了,本小节将介绍如下内容:","爬虫最开始遍历的网址。","爬虫源代码或配置规则储存在app上,需要被部署到各个worker节点中。","现在,只需要启动nginx服务就完成了启动前端服务。","直接部署","直接部署是之前没有docker时的部署方式,相对于docker部署来说有些繁琐。但了解如何直接部署可以帮助更深入地理解docker是如何构建crawlab镜像的。这里简单介绍一下。","知识)做进一步了解。简单来说,docker可以利用已存在的镜像帮助构建一些常用的服务和应用,例如nginx、mongodb、redis等等。用docker运行一个mongodb服务仅需dock","结果储存在数据库中之后,我们有时候需要将其导出,这时可以在界面中进行导出操作。","统计数据","网站","网站信息是帮助用户查看站长之家收录网站的信息的,包含robots协议、首页响应等信息。","自定义爬虫","自定义爬虫是指用户可以添加的任何语言任何框架的爬虫,高度自定义化。当用户添加好自定义爬虫之后,crawlab就可以将其集成到爬虫管理的系统中来。","自定义爬虫的添加有两种方式:","节点","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口。","节点其实就是celery中的worker。一个节点运行时会连接到一个任务队列(例如redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的ip地址和端口(默认为localhost:8000)。","要查看统计数据的话,只需要在爬虫详情中,点击分析标签,就可以看到爬虫的统计数据了。","该模式同样会启动3个后端服务和1个前端服务。前端服务是通过npm","详情页字段","输入完基本信息,点击添加。","运行docker容器","运行爬虫","这个方式稍微有些繁琐,但是对于无法轻松获取服务器的读写权限时是非常有用的,适合在生产环境上使用。","这个默认是开启的。如果开启,爬虫将先抓取网站的robots.txt并判断页面是否可抓;否则,不会对此进行验证。用户可以选择将其关闭。请注意,任何无视robots协议的行为都有法律风险。","这也是爬虫抓取采用的策略,也就是爬虫遍历网页是如何进行的。作为第一个版本,我们有仅列表、仅详情页、列表+详情页。","这些都是再列表页或详情页中需要提取的字段。字段由css选择器或者xpath来匹配提取。可以选择文本或者属性。","这应该是部署应用的最方便也是最节省时间的方式了。在最近的一次版本更新v0.2.3中,我们发布了docker功能,让大家可以利用docker来轻松部署crawlab。下面将一步一步介绍如何使用docker来部署crawlab。","这是一个flask应用,提供了必要的api来支持常规操作,例如crud、爬虫部署以及任务运行。每一个节点需要启动flask应用来支持爬虫部署。运行python","这样的话,pull镜像的速度会比不改变镜像源的速度快很多。","这样,pm2会启动3个守护进程来管理这3个服务。我们如果想看后端服务的日志的话,可以执行以下命令。","这样,我们就完成了节点的配置工作。","这种方式非常方便,但是需要获得主机服务器的读写权限,因而比较适合在开发环境上采用。","这里先定义了master节点,也就是crawlab的主节点。master依赖于mongo和redis容器,因此在启动之前会同时启动mongo和redis容器。这样就不需要单独配置mongo和redis服务了,大大节省了环境配置的时间。","这里启动了多增加了两个worker节点,以worker模式启动。这样,多节点部署,也就是分布式部署就完成了。","这里已经有一些配置好的初始输入项。我们简单介绍一下各自的含义。","这里我们选择列表+详情页。","这里是指启动后端服务。我们用pm2来管理进程。执行以下命令。","这里的cron跟linux中的crontab是一致的。如果对crontab不了解,可以参考这篇文章。","这里的构建是指前端构建,需要执行以下命令。","这里的爬虫部署是指自定义爬虫的部署,因为可配置爬虫已经内嵌到crawlab中了,所有节点都可以使用,不需要额外部署。简单来说,就是将主机上的爬虫源代码通过http的方式打包传输至worker节点上,因此节点就可以运行传输过来的爬虫了。","通过web界面上传","通过web界面上传爬虫","通过创建项目目录","通过添加项目目录","遵守robots协议","部署好之后,我们就可以运行爬虫了。","部署爬虫","部署爬虫很简单,有三种方式:","配置","配置爬虫","镜像之前,我们需要配置一下镜像源。因为我们在墙内,使用原有的镜像源速度非常感人,因此将使用dockerhub在国内的加速器。创建/etc/docker/daemon.json文件,在其中输入如下内容。","项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。","预览模式","预览模式是一种让用户比较快的上手的一种部署模式。跟直接部署类似,但不用经过构建、nginx和启动服务的步骤。在启动时只需要执行以下命令就可以了。相较于直接部署来说方便一些。","首先是将github上的代码拉取到本地。","首先,我们来看如何安装crawlab吧,请查看安装。"],"pipeline":["stopWordFilter","stemmer"]},"store":{"./":{"url":"./","title":"Crawlab简介","keywords":"","body":"Crawlab\n基于Celery的爬虫分布式爬虫管理平台,支持多种编程语言以及多种爬虫框架.\n查看演示 Demo\nCrawlab是基于Celery的分布式爬虫管理平台,可以集成任何语言和任何框架。\n项目自今年三月份上线以来受到爬虫爱好者们和开发者们的好评,不少使用者还表示会用Crawlab搭建公司的爬虫平台。经过近3个月的迭代,我们陆续上线了定时任务、数据分析、网站信息、可配置爬虫、自动提取字段、下载结果、上传爬虫等功能,将Crawlab打造得更加实用,更加全面,能够真正帮助用户解决爬虫管理困难的问题。\nCrawlab主要解决的是大量爬虫管理困难的问题,例如需要监控上百个网站的参杂scrapy和selenium的项目不容易做到同时管理,而且命令行管理的成本非常高,还容易出错。Crawlab支持任何语言和任何框架,配合任务调度、任务监控,很容易做到对成规模的爬虫项目进行有效监控管理。\n本使用手册会帮助您解决在安装使用Crawlab遇到的任何问题。\n首先,我们来看如何安装Crawlab吧,请查看安装。\n"},"Installation/":{"url":"Installation/","title":"安装Crawlab","keywords":"","body":"本小节将介绍三种安装Docker的方式:\n\nDocker\n直接部署\n预览模式\n\n"},"Installation/Docker.html":{"url":"Installation/Docker.html","title":"Docker","keywords":"","body":"Docker安装部署\n这应该是部署应用的最方便也是最节省时间的方式了。在最近的一次版本更新v0.2.3中,我们发布了Docker功能,让大家可以利用Docker来轻松部署Crawlab。下面将一步一步介绍如何使用Docker来部署Crawlab。\n对Docker不了解的开发者,可以参考一下这篇文章(9102 年了,学点 Docker 知识)做进一步了解。简单来说,Docker可以利用已存在的镜像帮助构建一些常用的服务和应用,例如Nginx、MongoDB、Redis等等。用Docker运行一个MongoDB服务仅需docker run -d --name mongo -p 27017:27017 mongo一行命令。如何安装Docker跟操作系统有关,这里就不展开讲了,需要的同学自行百度一下相关教程。\n下载镜像\n我们已经在DockerHub上构建了Crawlab的镜像,开发者只需要将其pull下来使用。在pull 镜像之前,我们需要配置一下镜像源。因为我们在墙内,使用原有的镜像源速度非常感人,因此将使用DockerHub在国内的加速器。创建/etc/docker/daemon.json文件,在其中输入如下内容。\n{\n \"registry-mirrors\": [\"https://registry.docker-cn.com\"]\n}\n\n这样的话,pull镜像的速度会比不改变镜像源的速度快很多。\n执行以下命令将Crawlab的镜像下载下来。镜像大小大概在几百兆,因此下载需要几分钟时间。\ndocker pull tikazyq/crawlab:latest\n\n更改配置文件\n拷贝一份后端配置文件./crawlab/config/config.py以及前端配置文件./frontend/.env.production到某一个地方。例如我的例子,分别为/home/yeqing/config.py和/home/yeqing/.env.production。\n更改后端配置文件config.py,将MongoDB、Redis的指向IP更改为自己数据的值。注意,容器中对应的宿主机的IP地址不是localhost,而是172.17.0.1(当然也可以用network来做,只是稍微麻烦一些)。更改前端配置文件.env.production,将API地址VUE_APP_BASE_URL更改为宿主机所在的IP地址,例如http://192.168.0.8:8000,这将是前端调用API会用到的URL。\n运行Docker容器\n更改好配置文件之后,接下来就是运行容器了。执行以下命令来启动容器。\ndocker run -d --rm --name crawlab \\\n -p 8080:8080 \\\n -p 8000:8000 \\\n -v /home/yeqing/.env.production:/opt/crawlab/frontend/.env.production \\\n -v /home/yeqing/config.py:/opt/crawlab/crawlab/config/config.py \\\n tikazyq/crawlab master\n\n其中,我们映射了8080端口(Nginx前端静态文件)以及8000端口(后端API)到宿主机。另外还将前端配置文件/home/yeqing/.env.production和后端配置文件/home/yeqing/config.py映射到了容器相应的目录下。传入参数master是代表该启动方式为主机启动模式,也就是所有服务(前端、Api、Flower、Worker)都会启动。另外一个模式是worker模式,只会启动必要的Api和Worker服务,这个对于分布式部署比较有用。等待大约20-30秒的时间来build前端静态文件,之后就可以打开Crawlab界面地址地址看到界面了。界面地址默认为http://localhost:8080。\n\nDocker-Compose\n当然,也可以用docker-compose的方式来部署。docker-compose是一个集群管理方式,可以利用名为docker-compose.yml的yaml文件来定义需要启动的容器,可以是单个,也可以(通常)是多个的。Crawlab的docker-compose.yml定义如下。\nversion: '3.3'\nservices:\n master: \n image: tikazyq/crawlab:latest\n container_name: crawlab\n volumns:\n - /home/yeqing/config.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports: \n - \"8080:8080\" # nginx\n - \"8000:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - master\n mongo:\n image: mongo:latest\n restart: always\n ports:\n - \"27017:27017\"\n redis:\n image: redis:latest\n restart: always\n ports:\n - \"6379:6379\"\n\n这里先定义了master节点,也就是Crawlab的主节点。master依赖于mongo和redis容器,因此在启动之前会同时启动mongo和redis容器。这样就不需要单独配置mongo和redis服务了,大大节省了环境配置的时间。\n安装docker-compose也很简单,大家去网上百度一下就可以了。\n安装完docker-compose和定义好docker-compose.yml后,只需要运行以下命令就可以启动Crawlab。\ndocker-compose up\n\n同样,在浏览器中输入http://localhost:8080就可以看到界面。\n多节点模式\ndocker-compose的方式很适合多节点部署,在原有的master基础上增加几个worker节点,达到多节点部署的目的。将docker-compose.yml更改为如下内容。\nversion: '3.3'\nservices:\n master: \n image: tikazyq/crawlab:latest\n container_name: crawlab\n volumns:\n - /home/yeqing/config.master.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production.master:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports: \n - \"8080:8080\" # nginx\n - \"8000:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - master\n worker1: \n image: tikazyq/crawlab:latest\n volumns:\n - /home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports:\n - \"8001:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - worker\n worker2: \n image: tikazyq/crawlab:latest\n volumns:\n - /home/yeqing/config.worker.py:/opt/crawlab/crawlab/config/config.py # 后端配置文件\n - /home/yeqing/.env.production.worker:/opt/crawlab/frontend/.env.production # 前端配置文件\n ports:\n - \"8002:8000\" # app\n depends_on:\n - mongo\n - redis\n entrypoint:\n - /bin/sh\n - /opt/crawlab/docker_init.sh\n - worker\n mongo:\n image: mongo:latest\n restart: always\n ports:\n - \"27017:27017\"\n redis:\n image: redis:latest\n restart: always\n ports:\n - \"6379:6379\"\n\n这里启动了多增加了两个worker节点,以worker模式启动。这样,多节点部署,也就是分布式部署就完成了。\n"},"Installation/Direct.html":{"url":"Installation/Direct.html","title":"直接部署","keywords":"","body":"直接部署\n直接部署是之前没有Docker时的部署方式,相对于Docker部署来说有些繁琐。但了解如何直接部署可以帮助更深入地理解Docker是如何构建Crawlab镜像的。这里简单介绍一下。\n拉取代码\n首先是将github上的代码拉取到本地。\ngit clone https://github.com/tikazyq/crawlab\n\n安装\n安装前端所需库。\nnpm install -g yarn pm2\ncd frontend\nyarn install\n\n安装后端所需库。\ncd ../crawlab\npip install -r requirements\n\n配置\n分别配置前端配置文件./frontend/.env.production和后端配置文件./crawlab/config/config.py。分别需要对部署后API地址以及数据库地址进行配置。\n构建\n这里的构建是指前端构建,需要执行以下命令。\ncd ../frontend\nnpm run build:prod\n\n构建完成后,会在./frontend目录下创建一个dist文件夹,里面是打包好后的静态文件。\nNginx\n安装nginx,在ubuntu 16.04是以下命令。\nsudo apt-get install nginx\n\n添加/etc/nginx/conf.d/crawlab.conf文件,输入以下内容。\nserver {\n listen 8080;\n server_name dev.crawlab.com;\n root /home/yeqing/jenkins_home/workspace/crawlab_develop/frontend/dist;\n index index.html;\n}\n其中,root是静态文件的根目录,这里是npm打包好后的静态文件。\n现在,只需要启动nginx服务就完成了启动前端服务。\nnginx reload\n\n启动服务\n这里是指启动后端服务。我们用pm2来管理进程。执行以下命令。\npm2 start app.py # API服务\npm2 start worker.py # Worker\npm2 start flower.py # Flower\n\n这样,pm2会启动3个守护进程来管理这3个服务。我们如果想看后端服务的日志的话,可以执行以下命令。\npm2 logs [app]\n\n然后在浏览器中输入http://localhost:8080就可以看到界面了。\n"},"Installation/Preview.html":{"url":"Installation/Preview.html","title":"预览模式","keywords":"","body":"预览模式\n预览模式是一种让用户比较快的上手的一种部署模式。跟直接部署类似,但不用经过构建、nginx和启动服务的步骤。在启动时只需要执行以下命令就可以了。相较于直接部署来说方便一些。\npython manage.py serve\n\n该模式同样会启动3个后端服务和1个前端服务。前端服务是通过npm run serve来进行的,因此是开发者模式。注意:强烈不建议在生产环境中用预览模式。预览模式只是让开发者快速体验Crawlab以及调试代码问题的一种方式,而不是用作生产环境部署的。\n"},"Usage/":{"url":"Usage/","title":"使用Crawlab","keywords":"","body":"本小节将介绍如何使用Crawlab,包括如下内容:\n\n节点\n爬虫\n任务\n定时任务\n\n"},"Usage/Node/":{"url":"Usage/Node/","title":"节点","keywords":"","body":"节点\n节点其实就是Celery中的Worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口(默认为localhost:8000)。\n\n查看节点\n修改节点信息\n\n"},"Usage/Node/View.html":{"url":"Usage/Node/View.html","title":"查看节点列表","keywords":"","body":"查看节点列表\n点击侧边栏的节点导航至节点列表,可以看到已上线的节点。这里的节点其实就是已经运行起来的celery worker,他们通过连接到配置好的broker(通常是redis)来进行与主机的通信。\n\n"},"Usage/Node/Edit.html":{"url":"Usage/Node/Edit.html","title":"修改节点信息","keywords":"","body":"修改节点信息\n后面我们需要让爬虫运行在各个节点上,需要让主机与节点进行通信,因此需要知道节点的IP地址和端口。我们需要手动配置一下节点的IP和端口。在节点列表中点击操作列里的蓝色查看按钮进入到节点详情。节点详情样子如下。\n\n在右侧分别输入该节点对应的节点IP和节点端口,然后点击保存按钮,保存该节点信息。\n这样,我们就完成了节点的配置工作。\n"},"Usage/Spider/":{"url":"Usage/Spider/","title":"爬虫","keywords":"","body":"爬虫\n爬虫就是我们通常说的网络爬虫了,本小节将介绍如下内容:\n\n创建爬虫\n部署爬虫\n运行爬虫\n可配置爬虫\n统计数据\n\n"},"Usage/Spider/Create.html":{"url":"Usage/Spider/Create.html","title":"创建爬虫","keywords":"","body":"创建爬虫\nCrawlab允许用户创建两种爬虫:\n\n自定义爬虫\n可配置爬虫\n\n前者可以通过Web界面和创建项目目录的方式来添加,后者由于没有源代码,只能通过Web界面来添加。\n"},"Usage/Spider/CustomizedSpider.html":{"url":"Usage/Spider/CustomizedSpider.html","title":"自定义爬虫","keywords":"","body":"自定义爬虫\n自定义爬虫是指用户可以添加的任何语言任何框架的爬虫,高度自定义化。当用户添加好自定义爬虫之后,Crawlab就可以将其集成到爬虫管理的系统中来。\n自定义爬虫的添加有两种方式:\n\n通过Web界面上传爬虫\n通过创建项目目录\n\n通过Web界面上传\n在通过Web界面上传之前,需要将爬虫项目文件打包成zip格式。\n\n然后,在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮,选择自定义爬虫,点击上传按钮,选择刚刚打包好的zip文件。上传成功后,爬虫列表中会出现新添加的自定义爬虫。这样就算添加好了。\n这个方式稍微有些繁琐,但是对于无法轻松获取服务器的读写权限时是非常有用的,适合在生产环境上使用。\n通过添加项目目录\nCrawlab会自动发现PROJECT_SOURCE_FILE_FOLDER目录下的所有爬虫目录,并将这些目录生成自定义爬虫并集成到Crawlab中。因此,将爬虫项目目录拷贝到PROJECT_SOURCE_FILE_FOLDER目录下,就可以添加一个爬虫了。\n这种方式非常方便,但是需要获得主机服务器的读写权限,因而比较适合在开发环境上采用。\n配置爬虫\n在定义爬虫中,我们需要配置一下执行命令(运行爬虫时后台执行的shell命令)和结果集(通过CRAWLAB_COLLECTION传递给爬虫程序,爬虫程序存储结果的地方),然后点击保存按钮保存爬虫信息。\n\n接下来,我们就可以部署、运行自定义爬虫了。\n"},"Usage/Spider/ConfigurableSpider.html":{"url":"Usage/Spider/ConfigurableSpider.html","title":"可配置爬虫","keywords":"","body":"可配置爬虫\n可配置爬虫是版本v0.2.1开发的功能。目的是将具有相似网站结构的爬虫项目可配置化,将开发爬虫的过程流程化,大大提高爬虫开发效率。\nCrawlab的可配置爬虫是基于Scrapy的,因此天生支持并发。而且,可配置爬虫完全支持自定义爬虫的一般功能,因此也支持任务调度、任务监控、日志监控、数据分析。\n添加爬虫\n在侧边栏点击爬虫导航至爬虫列表,点击添加爬虫按钮。\n\n点击可配置爬虫。\n\n输入完基本信息,点击添加。\n\n配置爬虫\n添加完成后,可以看到刚刚添加的可配置爬虫出现了在最下方,点击查看进入到爬虫详情。\n\n点击配置标签进入到配置页面。接下来,我们需要对爬虫规则进行配置。\n\n这里已经有一些配置好的初始输入项。我们简单介绍一下各自的含义。\n抓取类别\n这也是爬虫抓取采用的策略,也就是爬虫遍历网页是如何进行的。作为第一个版本,我们有仅列表、仅详情页、列表+详情页。\n\n仅列表页。这也是最简单的形式,爬虫遍历列表上的列表项,将数据抓取下来。\n仅详情页。爬虫只抓取详情页。\n列表+详情页。爬虫先遍历列表页,将列表项中的详情页地址提取出来并跟进抓取详情页。\n\n这里我们选择列表+详情页。\n列表项选择器 & 分页选择器\n列表项的匹和分页按钮的匹配查询,由CSS或XPath来进行匹配。\n开始URL\n爬虫最开始遍历的网址。\n遵守Robots协议\n这个默认是开启的。如果开启,爬虫将先抓取网站的robots.txt并判断页面是否可抓;否则,不会对此进行验证。用户可以选择将其关闭。请注意,任何无视Robots协议的行为都有法律风险。\n列表页字段 & 详情页字段\n这些都是再列表页或详情页中需要提取的字段。字段由CSS选择器或者XPath来匹配提取。可以选择文本或者属性。\n在检查完目标网页的元素CSS选择器之后,我们输入列表项选择器、开始URL、列表页/详情页等信息。注意勾选url为详情页URL。\n\n点击保存、预览,查看预览内容。\n\n"},"Usage/Spider/Deploy.html":{"url":"Usage/Spider/Deploy.html","title":"部署爬虫","keywords":"","body":"部署爬虫\n这里的爬虫部署是指自定义爬虫的部署,因为可配置爬虫已经内嵌到Crawlab中了,所有节点都可以使用,不需要额外部署。简单来说,就是将主机上的爬虫源代码通过HTTP的方式打包传输至worker节点上,因此节点就可以运行传输过来的爬虫了。\n部署爬虫很简单,有三种方式:\n\n在爬虫列表中点击部署所有爬虫,将所有爬虫部署到所有在线节点中;\n在爬虫列表中点击操作列的部署按钮,将指定爬虫部署到所有在线节点中;\n在爬虫详情的概览标签中,点击部署按钮,将指定爬虫部署到所有在线节点中。\n\n部署好之后,我们就可以运行爬虫了。\n"},"Usage/Spider/Run.html":{"url":"Usage/Spider/Run.html","title":"运行爬虫","keywords":"","body":"运行爬虫\n我们有两种运行爬虫的方式:\n\n手动触发\n定时任务触发\n\n手动触发\n\n在爬虫列表中操作列点击运行按钮,或者\n在爬虫详情中概览标签下点击运行按钮,或者\n对于自定义爬虫,可以在配置标签下点击运行按钮\n\n然后,Crawlab会提示任务已经派发到队列中去了,然后你可以在爬虫详情左侧看到新创建的任务。点击创建时间可以导航至任务详情。\n定时任务触发\n定时任务触发是比较常用的功能,对于增量抓取或对实时性有要求的任务很重要。这在定时任务中会详细介绍。\n"},"Usage/Spider/Analytics.html":{"url":"Usage/Spider/Analytics.html","title":"统计数据","keywords":"","body":"统计数据\n在运行了一段时间之后,爬虫会积累一些统计数据,例如运行成功率、任务数、运行时长等指标。Crawlab将这些指标汇总并呈现给开发者。\n要查看统计数据的话,只需要在爬虫详情中,点击分析标签,就可以看到爬虫的统计数据了。\n\n"},"Usage/Task/":{"url":"Usage/Task/","title":"任务","keywords":"","body":"任务\n任务其实就是指某一次抓取任务或采集任务。任务与爬虫关联,其执行的也是爬虫指定的执行命令或采集规则。抓取或采集的结果与任务关联,因此可以查看到每一次任务的结果集。Crawlab的任务是整个采集流程的核心,抓取的过程都是跟任务关联起来的,因此任务对于Crawlab来说非常重要。任务被app触发,worker通过任务队列接收任务,然后在其所在节点上执行任务。\n本小节将介绍以下内容:\n\n查看任务\n操作任务\n下载结果\n\n"},"Usage/Task/View.html":{"url":"Usage/Task/View.html","title":"查看任务","keywords":"","body":"查看任务\n任务列表\n点击侧边栏的任务导航至任务列表。可以看到最近的10个生成的任务。可以根据节点、爬虫来过滤任务。\n\n点击操作列的查看按钮,进入到该任务的任务详情。\n任务日志\n点击日志标签,可以查看任务日志。\n\n任务结果\n点击结果标签,可以查看任务结果。\n\n"},"Usage/Task/Action.html":{"url":"Usage/Task/Action.html","title":"操作任务","keywords":"","body":"操作任务\n停止任务\n当任务运行起来之后,我们因为某个原因可能需要终止任务,这时我们需要在Crawlab中停止该任务。\n导航至需要停止的任务的任务详情,点击停止按钮来终止任务。\n删除任务\n在任务列表中,点击操作列中的删除按钮,确认删除该任务。\n"},"Usage/Task/DownloadResults.html":{"url":"Usage/Task/DownloadResults.html","title":"下载结果","keywords":"","body":"下载结果\n结果储存在数据库中之后,我们有时候需要将其导出,这时可以在界面中进行导出操作。\n导航至任务详情,点击结果标签,点击下载CSV按钮,等待一会儿,结果就会以CSV的形式下载到本地。\n"},"Usage/Schedule/":{"url":"Usage/Schedule/","title":"定时任务","keywords":"","body":"定时任务\n定时任务是指定某个时刻,重复性地执行的任务,英文叫做Periodical Tasks,在Linux中也被称为Crontab。定时任务可以让任务可以被执行多次,而用户则不用手动的操作来执行任务。在生产环境中,这非常常见。定时任务对于对增量抓取或对数据实时性有要求的用户来说非常有用。\n在Crawlab中,定时任务是通过apscheduler来实现的。创建一个定时任务之后,会在名为mongo的jobstore中创建一个periodical job,apscheduler调度引擎将会不断的去数据库中匹配任务的执行时间,如果执行时间满足要求,则会在后台触发一次任务运行。\n定时任务列表会进行更新。每一次爬虫更新、删除、创建,以及定时任务的更新、删除、创建,都会触发定时任务列表的更新。\n创建定时任务\n导航至定时任务页面,可以看到定时任务的列表。\n点击添加定时任务,弹出创建定时任务的弹框。填写相应的内容,点击提交按钮创建定时任务。\n\n这里的Cron跟Linux中的crontab是一致的。如果对crontab不了解,可以参考这篇文章。\n修改定时任务\n导航至定时任务页面,点击操作列的修改按钮,弹出修改定时任务的弹框。填写相应的内容,点击提交按钮修改定时任务。\n删除定时任务\n导航至定时任务页面,点击操作列的删除按钮,确认删除该任务。\n"},"Usage/Site/":{"url":"Usage/Site/","title":"网站","keywords":"","body":"网站\n网站信息是帮助用户查看站长之家收录网站的信息的,包含Robots协议、首页响应等信息。\n\n"},"Architecture/":{"url":"Architecture/","title":"架构","keywords":"","body":"架构\nCrawlab的架构跟Celery非常相似,但是加入了包括前端、爬虫、Flower在内的额外模块,以支持爬虫管理的功能。架构图如下。\n\n节点 Node\n节点其实就是Celery中的worker。一个节点运行时会连接到一个任务队列(例如Redis)来接收和运行任务。所有爬虫需要在运行时被部署到节点上,用户在部署前需要定义节点的IP地址和端口。\n后台应用 Backend App\n这是一个Flask应用,提供了必要的API来支持常规操作,例如CRUD、爬虫部署以及任务运行。每一个节点需要启动Flask应用来支持爬虫部署。运行python app.py来启动应用。\n爬虫 Spider\n爬虫源代码或配置规则储存在App上,需要被部署到各个worker节点中。\n任务 Task\n任务被触发并被节点执行。用户可以在任务详情页面中看到任务到状态、日志和抓取结果。\n中间者 Broker\n中间者跟Celery中定义的一样,作为运行异步任务的队列。\n前端 Frontend\n前端其实就是一个基于Vue-Element-Admin的单页应用。其中重用了很多Element-UI的控件来支持相应的展示。\nFlower\n一个Celery的插件,用于监控Celery节点。\n"},"Examples/":{"url":"Examples/","title":"样例","keywords":"","body":"样例\n\n与Scrapy集成\n\n"},"Examples/ScrapyIntegration.html":{"url":"Examples/ScrapyIntegration.html","title":"与Scrapy集成","keywords":"","body":"与Scrapy集成\n以下是Crawlab跟Scrapy集成的例子,利用了Crawlab传过来的task_id和collection_name。\nimport os\nfrom pymongo import MongoClient\n\nMONGO_HOST = '192.168.99.100'\nMONGO_PORT = 27017\nMONGO_DB = 'crawlab_test'\n\n# scrapy example in the pipeline\nclass JuejinPipeline(object):\n mongo = MongoClient(host=MONGO_HOST, port=MONGO_PORT)\n db = mongo[MONGO_DB]\n col_name = os.environ.get('CRAWLAB_COLLECTION')\n if not col_name:\n col_name = 'test'\n col = db[col_name]\n\n def process_item(self, item, spider):\n item['task_id'] = os.environ.get('CRAWLAB_TASK_ID')\n self.col.save(item)\n return item\n\n"}}} \ No newline at end of file diff --git a/gitbook/img/crawlab-architecture.png b/gitbook/img/crawlab-architecture.png deleted file mode 100644 index fcac460f..00000000 Binary files a/gitbook/img/crawlab-architecture.png and /dev/null differ diff --git a/gitbook/img/payment.jpg b/gitbook/img/payment.jpg deleted file mode 100644 index 2b20f2d8..00000000 Binary files a/gitbook/img/payment.jpg and /dev/null differ diff --git a/gitbook/img/用户使用流程图.png b/gitbook/img/用户使用流程图.png deleted file mode 100644 index a4569075..00000000 Binary files a/gitbook/img/用户使用流程图.png and /dev/null differ