git-sync/crawlab
1
0
Fork 0
mirror of https://github.com/crawlab-team/crawlab.git synced 2026-01-21 17:21:09 +01:00
Code Issues Packages Projects Releases Wiki Activity
8 Commits 6 Branches 35 Tags
bbeb5ca5b5004a6fa37f5d57b751da1cbc1c6e18
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Yeqing Zhang bbeb5ca5b5 added deploys
2019-02-13 20:53:15 +08:00
.idea/httpRequests
added deploys
2019-02-13 20:53:15 +08:00
bin
added base class for api handling
2019-02-12 06:58:54 +08:00
config
added deploys
2019-02-13 20:53:15 +08:00
constants
added models
2019-02-12 13:08:04 +08:00
db
added deploys
2019-02-13 20:53:15 +08:00
logger
added celery functionality
2019-02-11 13:25:33 +08:00
model
added deploys
2019-02-13 20:53:15 +08:00
routes
added deploys
2019-02-13 20:53:15 +08:00
spiders/baidu
added deploys
2019-02-13 20:53:15 +08:00
tasks
added celery functionality
2019-02-11 13:25:33 +08:00
test
added deploys
2019-02-13 20:53:15 +08:00
utils
added base class for api handling
2019-02-12 06:58:54 +08:00
.gitignore
added celery functionality
2019-02-11 13:25:33 +08:00
app.py
added base class for api handling
2019-02-12 06:58:54 +08:00
LICENSE
Initial commit
2019-02-10 14:02:00 +08:00
README.md
Initial commit
2019-02-10 14:02:00 +08:00
route.py
task CRUD update
2019-02-11 22:29:35 +08:00

README.md

crawlab

Centralized admin platform for managing web crawlers including scrapy, pyspider, webmagic and much more

Reference in New Issue View Git Blame Copy Permalink
Description
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
crawlabcrawlercrawling-tasksdockergoplatformscrapyscrapyd-uispiderspiders-managementweb-crawlerwebcrawlerwebspider
Readme BSD-3-Clause 30 MiB
Languages
Go 99.3%
Shell 0.6%
Dockerfile 0.1%