Commit Graph

11 Commits

Author SHA1 Message Date
Marvin Zhang
14cb437112 add auth to mongodb connection 2019-06-12 21:21:32 +08:00
Marvin Zhang
8796070339 pagination change 2019-06-09 17:11:42 +08:00
Marvin Zhang
ada606afbb pagination change 2019-06-09 17:01:17 +08:00
Marvin Zhang
bc5d394e52 updated settings 2019-06-03 12:55:46 +08:00
Marvin Zhang
d03197042d allow generate URLs by pattern 2019-05-28 14:59:21 +08:00
Marvin Zhang
db263d83b2 added generate_urls function 2019-05-28 13:32:00 +08:00
Marvin Zhang
823c7f6b53 added generate_urls function 2019-05-28 13:27:25 +08:00
Marvin Zhang
113be056ae updated configurable spider 2019-05-26 19:17:02 +08:00
Marvin Zhang
e30c1c122a updated configurable spider 2019-05-26 19:16:46 +08:00
Marvin Zhang
5daebcb39b updated configurable spider 2019-05-26 17:10:04 +08:00
Marvin Zhang
04789febc8 prepared for configurable spiders 2019-05-24 17:28:25 +08:00