Commit Graph

7 Commits

Author SHA1 Message Date
Marvin Zhang
d03197042d allow generate URLs by pattern 2019-05-28 14:59:21 +08:00
Marvin Zhang
db263d83b2 added generate_urls function 2019-05-28 13:32:00 +08:00
Marvin Zhang
823c7f6b53 added generate_urls function 2019-05-28 13:27:25 +08:00
Marvin Zhang
113be056ae updated configurable spider 2019-05-26 19:17:02 +08:00
Marvin Zhang
e30c1c122a updated configurable spider 2019-05-26 19:16:46 +08:00
Marvin Zhang
5daebcb39b updated configurable spider 2019-05-26 17:10:04 +08:00
Marvin Zhang
04789febc8 prepared for configurable spiders 2019-05-24 17:28:25 +08:00