added cron tasks for spiders

This commit is contained in:
Marvin Zhang
2019-03-09 14:05:14 +08:00
parent 2f0107fff4
commit 647fac1efe
36 changed files with 263 additions and 508 deletions

View File

@@ -15,7 +15,7 @@ Celery-based web crawler admin platform for managing distributed web spiders reg
```bash
# install the requirements for backend
pip install -r ./crawlab/requirements.txt
pip install -r requirements.txt
```
```bash