34 Commits

Author SHA1 Message Date
Marvin Zhang
22497d22f7 fix: unable to filter tasks issue 2025-06-17 09:28:25 +08:00
Marvin Zhang
0bd2b62792 feat: add DTOs for models and update project spiders type to array 2025-06-12 19:58:21 +08:00
Marvin Zhang
8e7f52ab07 chore: update dependencies and improve module configurations
- Added new dependencies: `github.com/crawlab-team/fizz`, `github.com/go-playground/validator/v10`, and `github.com/google/go-cmp`.
- Updated existing dependencies: `github.com/spf13/cobra` to v1.7.0, `github.com/inconshreveable/mousetrap` to v1.1.0, and `golang.org/x/exp` to v0.0.0-20241217172543-b2144cdd0a67.
- Removed outdated dependencies from `go.sum` to streamline the module.
- Adjusted Go version in `go.mod` files to 1.23.0 for improved compatibility.
- Enhanced indirect dependencies for better performance and stability.
2025-04-24 18:31:12 +08:00
Marvin Zhang
a43f0cc5da chore: update dependencies and add OpenAPI support
- Added github.com/getkin/kin-openapi v0.130.0 to go.mod and updated go.sum for improved OpenAPI integration.
- Introduced DefaultOpenAPIUrl constant in config.go for easier configuration of OpenAPI URL.
- Implemented GetOpenAPIUrl function to retrieve the OpenAPI URL from configuration, enhancing flexibility in API documentation handling.
2025-03-17 18:17:32 +08:00
Marvin Zhang
95a6eb4e7b chore: add OpenTelemetry auto SDK dependency
- Introduced go.opentelemetry.io/auto/sdk v1.1.0 to go.mod and updated go.sum accordingly.
- Enhanced observability capabilities by including the OpenTelemetry SDK for automatic instrumentation.
- Ensured consistency in dependency management across the project.
2025-03-17 14:24:07 +08:00
Marvin Zhang
bc5e6273b8 chore: update dependencies and refactor imports
- Updated various dependencies in go.mod and go.sum for improved stability and performance.
- Replaced references to the old fizz package with the new crawlab-team/fizz package in multiple files.
- Adjusted indirect dependencies to their latest versions for better compatibility.
- Enhanced overall code clarity by standardizing import paths across the project.
2025-03-17 12:08:35 +08:00
Marvin Zhang
ddff881954 chore: update Go version and dependencies
- Updated Go version in go.work and backend/go.mod to 1.23.7
- Updated various dependencies in go.sum and backend/go.sum
- Refactored models to remove generic type parameters from BaseModel
- Introduced new utility functions for consistent API responses
- Removed unused utility files from controllers
2025-03-12 23:20:06 +08:00
Marvin Zhang
d6badb533d feat: enhance API routing and OpenAPI documentation support
- Introduced a new OpenAPI wrapper using Fizz for improved API documentation
- Refactored base controller to support more flexible route handling
- Added dynamic route registration with OpenAPI metadata
- Implemented generic response types for consistent API responses
- Updated router initialization to support OpenAPI documentation endpoint
- Improved route and resource naming utilities
- Migrated existing controllers to use new routing and response mechanisms
2025-03-11 23:45:06 +08:00
Marvin Zhang
17f8917d0a chore: update dependencies and enhance gRPC services
- Updated various dependencies in go.mod and go.sum files, including cloud.google.com/go/compute/metadata to v0.5.2, google.golang.org/grpc to v1.69.2, and google.golang.org/protobuf to v1.36.1.
- Refactored gRPC service definitions to use the latest protoc-gen-go and protoc versions, ensuring compatibility with the latest gRPC-Go features.
- Introduced a new logger utility in core/utils/logger.go to improve logging capabilities across the application.
- Added a README.md for gRPC setup and compilation guidance, enhancing developer experience.
- Improved the Python installation script to handle version listing more effectively and ensure user-specific environment setup.
2024-12-25 17:46:49 +08:00
Marvin Zhang
a13893b627 feat: add logo printing functionality and update logger usage
- Introduced a new utility function to print a logo and welcome information for the Crawlab server, enhancing user experience during startup.
- Updated logger variable names in the apps package for consistency and clarity.
- Added a new dependency on github.com/common-nighthawk/go-figure to facilitate logo rendering.
- Improved the server command to display the logo when the server starts, provided the user is not using the pro version.
2024-12-25 13:08:56 +08:00
Marvin Zhang
c897fb58e4 refactor: streamline error handling and improve HTTP request management
- Removed the print flag from handleError function, simplifying error logging based on the development environment.
- Introduced a new performRequest function for standardized HTTP requests with JSON bodies, enhancing code reusability.
- Updated SendIMNotification and related functions to utilize the new RequestParam type for better clarity and consistency.
- Normalized HTTP request paths in the createHttpRequest method to ensure correct URL formatting.
- Added detailed error logging for JSON unmarshaling failures in syncFiles method.
- Introduced a NewHttpClient function to create HTTP clients with customizable timeouts.
2024-12-21 11:27:58 +08:00
Marvin Zhang
f5631f965d chore: updated deps 2024-12-20 12:00:14 +08:00
Marvin Zhang
9560da66b5 test: fix test cases issues 2024-11-22 17:43:59 +08:00
Marvin Zhang
110078333e test: fix test cases 2024-11-22 11:32:20 +08:00
Marvin Zhang
b3261343b8 refactor: code cleanup 2024-11-20 18:22:27 +08:00
Marvin Zhang
75fdc863a6 chore: updated deps 2024-11-06 12:07:03 +08:00
Marvin Zhang
82e078076c refactor: cleanup code 2024-10-25 11:18:57 +08:00
Marvin Zhang
0898b344df chore: updated deps 2024-10-16 20:57:15 +08:00
Marvin Zhang
dd6921d32b feat: Update notification trigger patterns and add alert trigger 2024-07-31 16:02:34 +08:00
Marvin Zhang
ea5ec117cc refactor: Remove unused code for SMTP authentication and add Gmail OAuth2 authentication support 2024-07-27 19:29:43 +08:00
Marvin Zhang
7f9fac0fc0 feat: updated notification settings and channels 2024-07-23 17:24:40 +08:00
Marvin Zhang
3385caf972 chore: updated deps 2024-07-02 09:51:47 +08:00
Marvin Zhang
1ea0a352c4 chore: updated deps 2024-06-29 22:30:56 +08:00
Marvin Zhang
1eb81b3f43 feat: finalized git progress for clone, pull, push
https://github.com/crawlab-team/crawlab/issues/1485
2024-06-29 22:29:34 +08:00
Marvin Zhang
73a5a64ba4 fix: notification issue 2024-06-26 13:18:28 +08:00
Marvin Zhang
9d21bad931 fix: file upload issue 2024-06-18 18:16:26 +08:00
Marvin Zhang
3727ea6970 fix: deps issue 2024-06-17 17:30:23 +08:00
Marvin Zhang
14394fa72d fix: dependency issue 2024-06-14 17:58:42 +08:00
Marvin Zhang
de987f7f12 fix: dependency issue 2024-06-14 17:47:30 +08:00
Marvin Zhang
0834d6771b fix: dependency issue 2024-06-14 17:32:56 +08:00
Marvin Zhang
27f2e42116 fix: dependency issue 2024-06-14 16:51:09 +08:00
Marvin Zhang
6a60433d25 feat: added modules 2024-06-14 16:37:48 +08:00
Marvin Zhang
dc21bce11f feat: added modules 2024-06-14 15:59:48 +08:00
Marvin Zhang
0b67fd9ece feat: added modules 2024-06-14 15:42:50 +08:00