git-sync/crawlab
1
0
Fork 0
mirror of https://github.com/crawlab-team/crawlab.git synced 2026-01-22 17:31:03 +01:00
Code Issues Packages Projects Releases Wiki Activity

updated spiders

Browse Source
This commit is contained in:
Marvin Zhang
2019-06-06 17:24:00 +08:00
parent a7dc962062
commit 5baff4f0c9
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
crawlab/routes/spiders.py
View File

@@ -509,7 +509,7 @@ class SpiderApi(BaseApi):
}, r.status_code
# get html parse tree
sel = etree.HTML(r.content)
sel = etree.HTML(r.content.decode('utf-8'))
# remove unnecessary tags
unnecessary_tags = [