crawlab/CHANGELOG.md

0.2.2 (unreleased)

Features / Enhancement

• Automatic Extract Fields: Automatically extracting data fields in list pages for configurable spider
• Baidu Tongji: Allow users to choose to report usage info to Baidu Tongji.

Bug Fixes

• Results Page Pagination: Fixes so the pagination of results page is working correctly. #45
• Schedule Tasks Duplicated Triggers: Set Flask DEBUG as False so that schedule tasks won't trigger twice. #32
• Frontend Environment: Added VUE_APP_BASE_URL as production mode environment variable so the API call won't be always localhost in deployed env #30

0.2.1 (2019-05-27)

• Configurable Spider: Allow users to create a spider to crawl data without coding.

0.2 (2019-05-10)

• Advanced Stats: Advanced analytics in spider detail view.
• Sites Data: Added sites list (China) for users to check info such as robots.txt and home page response time/code.

0.1.1 (2019-04-23)

• Basic Stats: User can view basic stats such as number of failed tasks and number of results in spiders and tasks pages.
• Near Realtime Task Info: Periodically (5 sec) polling data from server to allow view task info in a near-realtime fashion.
• Scheduled Tasks: Allow users to set up cron-like scheduled/periodical tasks using apscheduler.

0.1 (2019-04-17)

• Initial Release