Commit Graph

6050 Commits

Author SHA1 Message Date
Marvin Zhang
c48d74bf0e feat: add active nodes management and project retrieval functionality 2025-06-09 10:50:33 +08:00
Marvin Zhang
975c601f38 refactor: simplify list retrieval methods and enhance error handling 2025-06-09 10:21:00 +08:00
Marvin Zhang
8a00af115c feat: refactor to remove unused 'getAllList' methods and related state properties 2025-06-09 10:20:39 +08:00
Marvin Zhang
7b3f431ebe Merge remote-tracking branch 'origin/develop' into develop 2025-06-06 15:00:13 +08:00
Marvin Zhang
8d32d54fe8 feat: add development and index generation run configurations; update SVG files and improve icon styles 2025-06-06 14:59:59 +08:00
Marvin Zhang
805ef38a87 feat: add translation for AutoProbe menu item in router 2025-06-03 13:10:45 +08:00
Marvin Zhang
2aefdd3ee1 feat: add AI assistant SVG icon and integrate it into the header with a toggle button 2025-05-30 23:27:47 +08:00
Marvin Zhang
1cb5133fe0 feat: unhide the AutoProbe route in the navigation menu 2025-05-29 22:24:52 +08:00
Marvin Zhang
062077a9bd feat: restructure user parameters for PostUser and simplify email validation; refactor UserAvatar styles and improve user name handling 2025-05-29 22:16:27 +08:00
Marvin Zhang
57348da3f2 feat: implement auto naming for URL input and enhance data fetching with debounce in AutoProbe components 2025-05-28 18:05:23 +08:00
Marvin Zhang
14027f1c0c feat: enhance AutoProbe state management with page pattern and data handling 2025-05-26 11:28:56 +08:00
Marvin Zhang
0f80639a96 feat: add OpenRouter support and refactor LLM provider imports
- Introduced OpenRouter as a new LLM provider in the system.
- Updated LLM provider imports from '@/utils/ai' to '@/utils/llm' for consistency.
- Added new SVG icon for OpenRouter in the assets directory.
- Enhanced AutoProbe interfaces to accommodate new pattern structures.
2025-05-25 23:13:37 +08:00
Marvin Zhang
0022b5ae40 feat: add display configuration options and enhance element filtering in AutoProbeResultsPreview component
- Introduced showLabel and focusMode options for better control over element display.
- Updated page element filtering logic to accommodate new focus mode functionality.
- Added translations for new display configuration options in English and Chinese.
- Included csstype dependency for improved type management in styles.
2025-05-21 00:03:04 +08:00
Marvin Zhang
9e56ae7b00 refactor: rename overlayRef to screenshotRef and update related scaling logic in AutoProbeResultsPreview component 2025-05-20 14:29:55 +08:00
Marvin Zhang
4857d22cd7 feat: add activeNavItem prop and enhance page element filtering in AutoProbe components 2025-05-19 18:07:01 +08:00
Marvin Zhang
50c4bc3750 feat: add viewport selection and run on create options in AutoProbeForm component 2025-05-19 17:32:40 +08:00
Marvin Zhang
da024f7b6f refactor: remove unused props definition in ChatMessageList component 2025-05-19 09:11:09 +08:00
Marvin Zhang
f1f74d8a6a feat: update AutoProbeResultsContainer and related interfaces for improved preview functionality
- Refactored AutoProbeResultsContainer to utilize new previewResult structure and updated API calls.
- Enhanced element styling and dynamic behavior for page elements in the preview.
- Introduced getIconByPageElementType utility for better icon management based on element type.
- Updated AutoProbe interfaces to reflect changes in data structure, including renaming PagePreview to PagePreviewResult and modifying page_elements type.
- Added rowKey functionality in AutoProbeList for improved table data handling.
2025-05-18 23:03:02 +08:00
Marvin Zhang
7afc4ba4c9 feat: enhance internationalization and update AutoProbe interfaces
- Updated Chinese translation for 'AutoProbe' to include its native term.
- Modified AutoProbe interfaces to improve data structure, including changes to page_data and the addition of new properties in AutoProbeTaskResult.
- Enhanced SidebarItem component to conditionally display badge values based on item properties.
2025-05-18 18:53:43 +08:00
Marvin Zhang
07a509c198 feat: implement preview functionality in AutoProbeResultsContainer with enhanced state management and new interfaces
- Added preview feature to display page screenshots and item coordinates.
- Introduced new interfaces for viewport and element coordinates in autoprobe models.
- Improved iframe loading state management and dynamic styling for preview elements.
- Updated AutoProbeDetailTabPatterns to pass activeId prop for better data handling.
2025-05-16 23:38:13 +08:00
Marvin Zhang
c0b0cc9f7e feat: improve iframe loading state management and enhance styling in AutoProbeResultsContainer 2025-05-16 18:17:07 +08:00
Marvin Zhang
2ec4707510 feat: enhance AutoProbe components with improved styling and iframe sandboxing 2025-05-16 17:52:05 +08:00
Marvin Zhang
5d837cca7e feat: add iframe support for URL preview in AutoProbeResultsContainer 2025-05-16 17:17:34 +08:00
Marvin Zhang
6705ce2ded feat: simplify results visibility management in AutoProbeResultsContainer 2025-05-16 13:32:10 +08:00
Marvin Zhang
9144ab5fe0 feat: enhance AutoProbeResultsContainer with dynamic cell styling and active field management 2025-05-16 13:13:13 +08:00
Marvin Zhang
f3d6a56315 refactor: update AutoProbe components and enhance structure
- Removed obsolete AutoProbeFieldDetail, AutoProbeListDetail, AutoProbePagePatternDetail, and AutoProbePaginationDetail components to streamline the codebase.
- Introduced new components: AutoProbeItemDetail and AutoProbePagePatternsSidebar for improved data management and user interaction.
- Updated index.ts to reflect new component structure and exports.
- Enhanced internationalization support with new translations for preview and extraction types.
- Refactored AutoProbeDetailTabPatterns to utilize new components and improve data handling.
2025-05-15 18:04:27 +08:00
Marvin Zhang
c654f03890 feat: update AutoProbe components and enhance functionality
- Removed AutoProbeFieldRule component and integrated AutoProbeSelector for improved selector management.
- Updated AutoProbePagePatternDetail to utilize new table structure for better data representation.
- Enhanced internationalization support with new translations for selector types and field counts.
- Refactored AutoProbeDetailTabPatterns to streamline data handling and improve user experience.
2025-05-13 23:37:15 +08:00
Marvin Zhang
54ad06aff6 feat: add AutoProbe components for enhanced data management
- Introduced new components: AutoProbeFieldDetail, AutoProbeFieldRule, AutoProbeListDetail, AutoProbePagePatternDetail, AutoProbePaginationDetail, and AutoProbePatternStats for detailed data representation.
- Updated index.ts to export new components for easier access.
- Enhanced internationalization support by adding relevant translations for new components and features.
- Added a new tab for patterns in the AutoProbe detail view to improve user navigation and data organization.
2025-05-13 17:58:57 +08:00
Marvin Zhang
c62d53576e feat: enhance AutoProbeDetailTabTasks with auto-update and confirmation dialog
- Integrated setupAutoUpdate to automatically refresh task list.
- Added confirmation dialog before running a task to improve user interaction.
- Simplified onBeforeMount lifecycle hook for better readability and performance.
2025-05-13 12:24:18 +08:00
Marvin Zhang
512f246094 feat: implement AutoProbe components and enhance LLM provider functionality
- Introduced AutoProbeForm and AutoProbeTaskStatus components for managing AutoProbe configurations and task statuses.
- Updated LLMProvider model to include a default model field for improved provider management.
- Enhanced AutoProbeList and AutoProbeDetail components for better user interaction and data display.
- Refactored related Vue components and services to streamline AutoProbe functionality and improve state management.
- Added internationalization support for new AutoProbe features and updated existing translations.
2025-05-12 17:37:30 +08:00
Marvin Zhang
ec5bcf9287 feat: introduce AutoProbe module and related interfaces
- Added AutoProbe interfaces to define models for autoprobe functionality, including AutoProbe, AutoProbeTask, and AutoProbeFetchResult.
- Created AutoProbeStore module for managing state, getters, mutations, and actions related to autoprobe.
- Updated existing LLM interfaces to utilize LLMResponseUsage for token tracking.
- Refactored store index to include autoprobe namespace and removed obsolete AiStore module.
2025-05-12 11:25:30 +08:00
Marvin Zhang
a10a05ea80 feat: add AutoProbeList component and related functionality
- Introduced AutoProbeList.vue component for displaying a list layout of extract items.
- Added useAutoProbeList.ts for managing state and interactions with the Vuex store.
- Updated .gitignore to exclude local configuration files.
2025-05-11 22:46:46 +08:00
Marvin Zhang
9e25ea9b51 refactor: standardize LLM provider key naming and enhance related components
- Renamed 'Key' fields to 'Type' in various models for consistency across the codebase.
- Updated route naming in router.go for clarity in the context of settings.
- Introduced a new LlmProviderForm component for managing LLM provider configurations.
- Refactored AssistantConsole and related components to utilize providerId instead of provider for improved state management.
- Enhanced UI elements and translations to reflect the new naming conventions and improve user experience.
2025-05-09 15:35:57 +08:00
Marvin Zhang
73b3c1bb70 refactor: add IgnoreFileRegexPattern constant for directory scanning
- Introduced a new constant `IgnoreFileRegexPattern` to specify patterns for files to ignore during directory scanning.
- Adjusted import order in `file.go` for improved organization and clarity.
2025-05-04 21:44:27 +08:00
Marvin Zhang
8e7f52ab07 chore: update dependencies and improve module configurations
- Added new dependencies: `github.com/crawlab-team/fizz`, `github.com/go-playground/validator/v10`, and `github.com/google/go-cmp`.
- Updated existing dependencies: `github.com/spf13/cobra` to v1.7.0, `github.com/inconshreveable/mousetrap` to v1.1.0, and `golang.org/x/exp` to v0.0.0-20241217172543-b2144cdd0a67.
- Removed outdated dependencies from `go.sum` to streamline the module.
- Adjusted Go version in `go.mod` files to 1.23.0 for improved compatibility.
- Enhanced indirect dependencies for better performance and stability.
2025-04-24 18:31:12 +08:00
Marvin Zhang
d1e6f5a29e refactor: enhance ChatMessage component for improved user experience
- Added loading indicator for streaming messages to inform users during processing.
- Updated token usage display to use an icon for better visual clarity and interaction.
- Refactored CSS styles for token usage to improve layout and hover effects.
- Removed redundant code for displaying message time, streamlining the template structure.
2025-04-24 15:35:34 +08:00
Marvin Zhang
fdd0595f49 refactor: update route naming for clarity in router.go
- Renamed route from "Get Spider Files" to "List Spider Files" for improved clarity.
- Enhanced description to specify that it lists files given a directory path in the spider project.
2025-04-23 15:50:10 +08:00
Marvin Zhang
f28720ab67 refactor: optimize type assertions and simplify sort option checks in utils.go
- Streamlined type assertions in convertFilterValue function for improved clarity and performance.
- Removed unnecessary nil checks for sorts in GetSortOptionFromString and GetSortsOption functions, enhancing code readability.
2025-04-23 13:58:16 +08:00
Marvin Zhang
c4f2d1e554 fix: restore missing error handling import in utils.go
- Reintroduced the 'github.com/juju/errors' import in utils.go to ensure proper error handling functionality is available in the codebase.
2025-04-23 13:55:04 +08:00
Marvin Zhang
1aa58f5065 refactor: remove unused task type field in runner test setup
- Eliminated the unused 'Type' field from the Task model in the runner test setup to enhance code clarity and maintainability.
2025-04-22 16:50:56 +08:00
Marvin Zhang
4f57d277e7 refactor: standardize timestamp fields and improve code clarity
- Updated timestamp fields across the codebase from `*_ts` to `*_at` for consistency and clarity.
- Renamed constants for node status from "on"/"off" to "online"/"offline" to better reflect their meanings.
- Enhanced validation and error handling in various components to ensure data integrity.
- Refactored test cases to align with the new naming conventions and improve readability.
2025-04-21 18:13:22 +08:00
Marvin Zhang
de680d8ebd refactor: streamline conversation initialization and enhance log handling
- Refactored AssistantConsole to utilize a dedicated initializeConversation function for improved clarity and organization.
- Updated DependencyLogsDialog to rename computed property from content to logs for better semantic understanding.
- Enhanced LogsView component by wrapping logs in an el-scrollbar for improved user experience.
- Adjusted ChatInput to call updateSelectedProviderModel on onBeforeMount for better state management.
- Simplified default model handling in ai.ts by introducing a DEFAULT_OPENAI_MODELS constant for consistency.
2025-04-18 16:58:42 +08:00
Marvin Zhang
32f0802f8b style: update AssistantConsole layout and extend store interface
- Added height to the AssistantConsole component for improved layout consistency.
- Extended StoreNamespace interface to include 'dataCollection' for better state management.
2025-04-18 09:40:59 +08:00
Marvin Zhang
34509b8d4c refactor: enhance parameter handling and improve code clarity
- Updated GetListParams to set a default sort option for better query handling.
- Enhanced PostSpiderRunParams to include a default mode and improved error handling for missing spider.
- Added parameters field to ChatMessageContent for more flexible message content management.
- Refactored getNodeIds method to simplify mode handling and removed unnecessary error checks.
- Improved ChatMessageAction component to display parameters and response sections more effectively, enhancing user experience.
2025-04-17 18:03:15 +08:00
Marvin Zhang
36c7d5e3a3 refactor: improve focus handling and simplify content parsing
- Refactored focus handling in useAssistantConsole to use a dedicated function for clarity and adjusted timeout duration.
- Simplified content parsing in ChatMessageAction by directly returning parsed JSON and removing unnecessary mapping logic.
- Updated ChatSidebar to allow a larger maximum width for improved layout flexibility.
- Removed unused interface definitions in llm.d.ts to clean up the codebase.
2025-04-17 16:28:56 +08:00
Marvin Zhang
336ca5770b fix: improve error handling and enhance setting management
- Updated error handling in GetSetting to use errors.Is for better clarity when checking for no documents.
- Refactored setting retrieval in the Vuex store to ensure a default value is set if the retrieved setting is empty.
- Adjusted API calls in the store to wrap payloads in a data object for consistency.
- Cleaned up SystemDetail.vue by removing unnecessary navigation actions for a more streamlined UI.
- Enhanced conditional rendering in SystemDetailTabDependency to ensure form value checks are safe.
- Replaced el-input with cl-edit-input in SystemDetailTabCustomize for improved input handling and added change event for saving.
2025-04-17 14:50:59 +08:00
Marvin Zhang
e0649dc91f chore: simplify Docker workflow by removing e2e test job
- Eliminated the e2e test job from the Docker workflow to streamline the CI process.
- Removed related environment variables and steps associated with e2e testing.
- Updated dependencies for the push_images job to reflect changes in the workflow structure.
2025-04-16 15:28:55 +08:00
Marvin Zhang
526b2c0579 feat: enhance Vite configuration and update metrics display
- Added support for JSX in Vite configuration by including the vueJsx plugin.
- Simplified the metrics display in CurrentMetrics.vue to show only the percentage of used memory and disk.
- Adjusted CSS in CurrentMetrics.vue to prevent wrapping and added a gap between items for better layout.
- Refactored TableCell.vue to remove unused imports, optimizing the component.
- Updated useNodeList.tsx to replace NodeType with ClNodeType and made minor formatting adjustments for consistency.
2025-04-16 14:57:51 +08:00
Marvin Zhang
4e6b00c1b1 feat: add LogsView component for displaying logs
- Introduced a new LogsView.vue component to present logs in a structured format.
- Implemented functionality to scroll to the bottom of the logs view for better user experience.
- Enhanced log processing to trim and format log entries for clarity.
2025-04-16 11:05:00 +08:00
Marvin Zhang
21df22fe24 chore: enhance Dockerfile for improved debugging
- Updated the Dockerfile to include additional commands for listing files in the application directory structure, aiding in the verification of file copying during the Docker build process.
2025-04-16 10:56:10 +08:00