git-sync/crawlab
1
0
Fork 0
mirror of https://github.com/crawlab-team/crawlab.git synced 2026-01-21 17:21:09 +01:00
Code Issues Packages Projects Releases Wiki Activity
Files
develop
crawlab/changelog/v0.4.md
Marvin Zhang 3106347fe9 Remove Chinese and English changelog files and add version-specific changelog files 
- Deleted CHANGELOG-zh.md and CHANGELOG.md
- Added version-specific changelog files in the changelog/ directory for v0.2, v0.3, v0.4, v0.5, and v0.6
- Included both Chinese and English versions for some changelog files
- Organized changelogs by version with detailed feature and bug fix descriptions
2025-02-17 11:12:47 +08:00

154 lines
7.2 KiB
Markdown
Raw Permalink Blame History

# 0.4.10 (2020-04-21)
### Features / Enhancement
- Centralized MongoDB logging
- API token authentication
- Webhook notifications
- Auto-install dependencies from requirements.txt/package.json
- Automatic results collection naming
- Improved project list display
- Node.js v10.19 upgrade
- Manual run button in schedules
### Bug Fixes
- Fixed registration issue [#670](https://github.com/crawlab-team/crawlab/issues/670)
- Corrected cron expression display [#678](https://github.com/crawlab-team/crawlab/issues/678)
- Fixed daily stats missing [#684](https://github.com/crawlab-team/crawlab/issues/684)
- Improved results count updates [#689](https://github.com/crawlab-team/crawlab/issues/689)
# 0.4.9 (2020-03-31)
### Features / Enhancement
- Achievement challenges
- Granular access controls
- User feedback system
- Improved dashboard metrics
- Configurable to custom spider conversion
- Schedule-triggered task tracking
- Result deduplication
- Task restart capability
### Bug Fixes
- Windows CLI compatibility [#580](https://github.com/crawlab-team/crawlab/issues/580)
- Re-upload errors [#643](https://github.com/crawlab-team/crawlab/issues/643)
- File directory sync issues [#646](https://github.com/crawlab-team/crawlab/issues/646)
# 0.4.8 (2020-03-11)
### Features / Enhancement
- **Multi-language support** - Added Java, .NET Core, PHP installations
- **Installation UI overhaul** - Better visualization of node setups
- **Git integration** - View commit history and checkout capabilities
- **Hostname registration** - Use hostname as node identifier
- **RPC framework** - Improved node communication system
- **Master node toggle** - Control where tasks execute
- **Documentation sidebar** - Quick access to relevant docs
### Bug Fixes
- Duplicate node registration [#391](https://github.com/crawlab-team/crawlab/issues/391)
- Spider upload conflicts [#603](https://github.com/crawlab-team/crawlab/issues/603)
- Dependency installation failures [#609](https://github.com/crawlab-team/crawlab/issues/609)
- Offline node task creation [#622](https://github.com/crawlab-team/crawlab/issues/622)
# 0.4.7 (2020-02-24)
### Features / Enhancement
- **Enhanced Scrapy support** - Auto-detection, settings config, log levels
- **Git synchronization** - Sync Git repositories to Crawlab
- **Long-running tasks** - Support for persistent spider processes
- **Spider list optimization** - Status-based task counters and charts
- **Version checking** - New version detection and notifications
- **Bulk spider operations** - Run/stop/delete multiple spiders
- **Spider cloning** - Duplicate existing spider configurations
### Bug Fixes
- Schedule task spider selection
- Conflicting cron expressions [#515](https://github.com/crawlab-team/crawlab/issues/515)
- Log file collisions [#577](https://github.com/crawlab-team/crawlab/issues/577)
# 0.4.6 (2020-02-13)
### Features / Enhancement
- **Node.js SDK** - Official SDK for Node.js spiders
- **Log management** - Search, error highlighting, auto-scroll
- **Task execution flow** - Direct navigation to new tasks
- **Parameter tracking** - Added args column to task lists
- **Timestamps in lists** - Created/updated time in spider views
- **Loading states** - Skeleton screens during loading
### Bug Fixes
- Schedule config focus loss [#519](https://github.com/crawlab-team/crawlab/issues/519)
- CLI upload failures [#524](https://github.com/crawlab-team/crawlab/issues/524)
# 0.4.5 (2020-02-03)
### Features / Enhancement
- **Interactive tutorials** - Guided walkthrough of key features
- **Global environment variables** - Apply to all spider executions [#177](https://github.com/crawlab-team/crawlab/issues/177)
- **Project management** - Organize spiders into projects [#316](https://github.com/crawlab-team/crawlab/issues/316)
- **Sample spiders** - Auto-added during initialization [#379](https://github.com/crawlab-team/crawlab/issues/379)
- **User permissions** - Restricted admin privileges [#456](https://github.com/crawlab-team/crawlab/issues/456)
- **Settings UI refresh** - Improved configuration interface
- **Result view optimization** - Better data presentation
### Bug Fixes
- Missing spider files [#485](https://github.com/crawlab-team/crawlab/issues/485)
- Delete button navigation [#480](https://github.com/crawlab-team/crawlab/issues/480)
- Empty spider file creation [#479](https://github.com/crawlab-team/crawlab/issues/479)
- CSV export errors [#465](https://github.com/crawlab-team/crawlab/issues/465)
# 0.4.4 (2020-01-17)
### Features / Enhancement
- **Email notifications** - Task status alerts via SMTP
- **IM integrations** - DingTalk/WeCom bot support
- **API endpoint optimization** - Relative path support
- **SDK compatibility** - Improved Scrapy integration
- **File tree navigation** - Sidebar directory structure
- **Visual cron editor** - Graphical schedule builder
### Bug Fixes
- Nil response errors
- HTTPS configuration issues
- Configurable spider execution
- File upload validation
# 0.4.3 (2020-01-07)
### Features / Enhancement
- **Dependency management** - Web-based package installation
- **Docker language packs** - Pre-install Node.js via env var
- **Cron standardization** - 5-field Linux-compatible format
- **Schedule toggles** - Enable/disable cron jobs [#297](https://github.com/crawlab-team/crawlab/issues/297)
- **Bulk task deletion** - Remove multiple tasks [#341](https://github.com/crawlab-team/crawlab/issues/341)
- **Spider filtering** - Sort/search in spider lists
- **Chinese changelog** - Localized release notes
### Bug Fixes
- Schedule task execution [#423](https://github.com/crawlab-team/crawlab/issues/423)
- ZIP upload issues [#403](https://github.com/crawlab-team/crawlab/issues/403)
- Network failure handling [#340](https://github.com/crawlab-team/crawlab/issues/340)
# 0.4.2 (2019-12-26)
### Features / Enhancement
- **Legal disclaimer** - Usage terms documentation
- **Version API** - Programmatic version checking [#371](https://github.com/crawlab-team/crawlab/issues/371)
- **Registration control** - Configurable signups [#346](https://github.com/crawlab-team/crawlab/issues/346)
- **File operations** - Create/edit/rename/delete files [#286](https://github.com/crawlab-team/crawlab/issues/286)
- **Spider creation flow** - Empty spider initialization
- **Task filtering** - Advanced search capabilities [#341](https://github.com/crawlab-team/crawlab/issues/341)
### Bug Fixes
- Duplicate nodes [#391](https://github.com/crawlab-team/crawlab/issues/391)
- MongoDB connection errors [#373](https://github.com/crawlab-team/crawlab/issues/373)
# 0.4.1 (2019-12-13)
### Features / Enhancement
- **Spiderfile format** - Changed stages to dictionary [#358](https://github.com/crawlab-team/crawlab/issues/358)
- **Analytics update** - Improved Baidu tracking
### Bug Fixes
- Schedule display issues [#353](https://github.com/crawlab-team/crawlab/issues/353)
- Node registration duplicates [#334](https://github.com/crawlab-team/crawlab/issues/334)
# 0.4.0 (2019-12-06)
### Major Features
- **Configurable spiders** - YAML-based spider creation
- **Execution modes** - All nodes/Specific node/Random
### Bug Fixes
- Task termination issues [#306](https://github.com/crawlab-team/crawlab/issues/306)
- Windows deployment problems [#288](https://github.com/crawlab-team/crawlab/issues/288)
- Log file management [#269](https://github.com/crawlab-team/crawlab/issues/269)
Reference in New Issue View Git Blame Copy Permalink