# 0.4.10 (2020-04-21) ### Features / Enhancement - Centralized MongoDB logging - API token authentication - Webhook notifications - Auto-install dependencies from requirements.txt/package.json - Automatic results collection naming - Improved project list display - Node.js v10.19 upgrade - Manual run button in schedules ### Bug Fixes - Fixed registration issue [#670](https://github.com/crawlab-team/crawlab/issues/670) - Corrected cron expression display [#678](https://github.com/crawlab-team/crawlab/issues/678) - Fixed daily stats missing [#684](https://github.com/crawlab-team/crawlab/issues/684) - Improved results count updates [#689](https://github.com/crawlab-team/crawlab/issues/689) # 0.4.9 (2020-03-31) ### Features / Enhancement - Achievement challenges - Granular access controls - User feedback system - Improved dashboard metrics - Configurable to custom spider conversion - Schedule-triggered task tracking - Result deduplication - Task restart capability ### Bug Fixes - Windows CLI compatibility [#580](https://github.com/crawlab-team/crawlab/issues/580) - Re-upload errors [#643](https://github.com/crawlab-team/crawlab/issues/643) - File directory sync issues [#646](https://github.com/crawlab-team/crawlab/issues/646) # 0.4.8 (2020-03-11) ### Features / Enhancement - **Multi-language support** - Added Java, .NET Core, PHP installations - **Installation UI overhaul** - Better visualization of node setups - **Git integration** - View commit history and checkout capabilities - **Hostname registration** - Use hostname as node identifier - **RPC framework** - Improved node communication system - **Master node toggle** - Control where tasks execute - **Documentation sidebar** - Quick access to relevant docs ### Bug Fixes - Duplicate node registration [#391](https://github.com/crawlab-team/crawlab/issues/391) - Spider upload conflicts [#603](https://github.com/crawlab-team/crawlab/issues/603) - Dependency installation failures [#609](https://github.com/crawlab-team/crawlab/issues/609) - Offline node task creation [#622](https://github.com/crawlab-team/crawlab/issues/622) # 0.4.7 (2020-02-24) ### Features / Enhancement - **Enhanced Scrapy support** - Auto-detection, settings config, log levels - **Git synchronization** - Sync Git repositories to Crawlab - **Long-running tasks** - Support for persistent spider processes - **Spider list optimization** - Status-based task counters and charts - **Version checking** - New version detection and notifications - **Bulk spider operations** - Run/stop/delete multiple spiders - **Spider cloning** - Duplicate existing spider configurations ### Bug Fixes - Schedule task spider selection - Conflicting cron expressions [#515](https://github.com/crawlab-team/crawlab/issues/515) - Log file collisions [#577](https://github.com/crawlab-team/crawlab/issues/577) # 0.4.6 (2020-02-13) ### Features / Enhancement - **Node.js SDK** - Official SDK for Node.js spiders - **Log management** - Search, error highlighting, auto-scroll - **Task execution flow** - Direct navigation to new tasks - **Parameter tracking** - Added args column to task lists - **Timestamps in lists** - Created/updated time in spider views - **Loading states** - Skeleton screens during loading ### Bug Fixes - Schedule config focus loss [#519](https://github.com/crawlab-team/crawlab/issues/519) - CLI upload failures [#524](https://github.com/crawlab-team/crawlab/issues/524) # 0.4.5 (2020-02-03) ### Features / Enhancement - **Interactive tutorials** - Guided walkthrough of key features - **Global environment variables** - Apply to all spider executions [#177](https://github.com/crawlab-team/crawlab/issues/177) - **Project management** - Organize spiders into projects [#316](https://github.com/crawlab-team/crawlab/issues/316) - **Sample spiders** - Auto-added during initialization [#379](https://github.com/crawlab-team/crawlab/issues/379) - **User permissions** - Restricted admin privileges [#456](https://github.com/crawlab-team/crawlab/issues/456) - **Settings UI refresh** - Improved configuration interface - **Result view optimization** - Better data presentation ### Bug Fixes - Missing spider files [#485](https://github.com/crawlab-team/crawlab/issues/485) - Delete button navigation [#480](https://github.com/crawlab-team/crawlab/issues/480) - Empty spider file creation [#479](https://github.com/crawlab-team/crawlab/issues/479) - CSV export errors [#465](https://github.com/crawlab-team/crawlab/issues/465) # 0.4.4 (2020-01-17) ### Features / Enhancement - **Email notifications** - Task status alerts via SMTP - **IM integrations** - DingTalk/WeCom bot support - **API endpoint optimization** - Relative path support - **SDK compatibility** - Improved Scrapy integration - **File tree navigation** - Sidebar directory structure - **Visual cron editor** - Graphical schedule builder ### Bug Fixes - Nil response errors - HTTPS configuration issues - Configurable spider execution - File upload validation # 0.4.3 (2020-01-07) ### Features / Enhancement - **Dependency management** - Web-based package installation - **Docker language packs** - Pre-install Node.js via env var - **Cron standardization** - 5-field Linux-compatible format - **Schedule toggles** - Enable/disable cron jobs [#297](https://github.com/crawlab-team/crawlab/issues/297) - **Bulk task deletion** - Remove multiple tasks [#341](https://github.com/crawlab-team/crawlab/issues/341) - **Spider filtering** - Sort/search in spider lists - **Chinese changelog** - Localized release notes ### Bug Fixes - Schedule task execution [#423](https://github.com/crawlab-team/crawlab/issues/423) - ZIP upload issues [#403](https://github.com/crawlab-team/crawlab/issues/403) - Network failure handling [#340](https://github.com/crawlab-team/crawlab/issues/340) # 0.4.2 (2019-12-26) ### Features / Enhancement - **Legal disclaimer** - Usage terms documentation - **Version API** - Programmatic version checking [#371](https://github.com/crawlab-team/crawlab/issues/371) - **Registration control** - Configurable signups [#346](https://github.com/crawlab-team/crawlab/issues/346) - **File operations** - Create/edit/rename/delete files [#286](https://github.com/crawlab-team/crawlab/issues/286) - **Spider creation flow** - Empty spider initialization - **Task filtering** - Advanced search capabilities [#341](https://github.com/crawlab-team/crawlab/issues/341) ### Bug Fixes - Duplicate nodes [#391](https://github.com/crawlab-team/crawlab/issues/391) - MongoDB connection errors [#373](https://github.com/crawlab-team/crawlab/issues/373) # 0.4.1 (2019-12-13) ### Features / Enhancement - **Spiderfile format** - Changed stages to dictionary [#358](https://github.com/crawlab-team/crawlab/issues/358) - **Analytics update** - Improved Baidu tracking ### Bug Fixes - Schedule display issues [#353](https://github.com/crawlab-team/crawlab/issues/353) - Node registration duplicates [#334](https://github.com/crawlab-team/crawlab/issues/334) # 0.4.0 (2019-12-06) ### Major Features - **Configurable spiders** - YAML-based spider creation - **Execution modes** - All nodes/Specific node/Random ### Bug Fixes - Task termination issues [#306](https://github.com/crawlab-team/crawlab/issues/306) - Windows deployment problems [#288](https://github.com/crawlab-team/crawlab/issues/288) - Log file management [#269](https://github.com/crawlab-team/crawlab/issues/269)