Commit Graph

34 Commits

Author SHA1 Message Date
Marvin Zhang
17f8917d0a chore: update dependencies and enhance gRPC services
- Updated various dependencies in go.mod and go.sum files, including cloud.google.com/go/compute/metadata to v0.5.2, google.golang.org/grpc to v1.69.2, and google.golang.org/protobuf to v1.36.1.
- Refactored gRPC service definitions to use the latest protoc-gen-go and protoc versions, ensuring compatibility with the latest gRPC-Go features.
- Introduced a new logger utility in core/utils/logger.go to improve logging capabilities across the application.
- Added a README.md for gRPC setup and compilation guidance, enhancing developer experience.
- Improved the Python installation script to handle version listing more effectively and ensure user-specific environment setup.
2024-12-25 17:46:49 +08:00
Marvin Zhang
2a33bd40f5 chore: update dependencies in go.mod and go.sum files
- Added github.com/common-nighthawk/go-figure as a new indirect dependency in both backend and core modules to support logo rendering functionality.
- Removed the github.com/imroc/req dependency from backend and go.sum files, streamlining the dependency list and improving project organization.
2024-12-25 14:16:38 +08:00
Marvin Zhang
a13893b627 feat: add logo printing functionality and update logger usage
- Introduced a new utility function to print a logo and welcome information for the Crawlab server, enhancing user experience during startup.
- Updated logger variable names in the apps package for consistency and clarity.
- Added a new dependency on github.com/common-nighthawk/go-figure to facilitate logo rendering.
- Improved the server command to display the logo when the server starts, provided the user is not using the pro version.
2024-12-25 13:08:56 +08:00
Marvin Zhang
dc59599509 refactor: remove db module and update imports to core/mongo
- Deleted the db module, consolidating database-related functionality into the core/mongo package for better organization and maintainability.
- Updated all import paths across the codebase to replace references to the removed db module with core/mongo.
- Cleaned up unused code and dependencies, enhancing overall project clarity and reducing complexity.
- This refactor improves the structure of the codebase by centralizing database operations and simplifying module management.
2024-12-25 10:28:21 +08:00
Marvin Zhang
c897fb58e4 refactor: streamline error handling and improve HTTP request management
- Removed the print flag from handleError function, simplifying error logging based on the development environment.
- Introduced a new performRequest function for standardized HTTP requests with JSON bodies, enhancing code reusability.
- Updated SendIMNotification and related functions to utilize the new RequestParam type for better clarity and consistency.
- Normalized HTTP request paths in the createHttpRequest method to ensure correct URL formatting.
- Added detailed error logging for JSON unmarshaling failures in syncFiles method.
- Introduced a NewHttpClient function to create HTTP clients with customizable timeouts.
2024-12-21 11:27:58 +08:00
Marvin Zhang
f5631f965d chore: updated deps 2024-12-20 12:00:14 +08:00
Marvin Zhang
9560da66b5 test: fix test cases issues 2024-11-22 17:43:59 +08:00
Marvin Zhang
110078333e test: fix test cases 2024-11-22 11:32:20 +08:00
Marvin Zhang
b3261343b8 refactor: code cleanup 2024-11-20 18:22:27 +08:00
Marvin Zhang
75fdc863a6 chore: updated deps 2024-11-06 12:07:03 +08:00
Marvin Zhang
82e078076c refactor: cleanup code 2024-10-25 11:18:57 +08:00
Marvin Zhang
0898b344df chore: updated deps 2024-10-16 20:57:15 +08:00
Marvin Zhang
dd6921d32b feat: Update notification trigger patterns and add alert trigger 2024-07-31 16:02:34 +08:00
Marvin Zhang
ea5ec117cc refactor: Remove unused code for SMTP authentication and add Gmail OAuth2 authentication support 2024-07-27 19:29:43 +08:00
Marvin Zhang
7f9fac0fc0 feat: updated notification settings and channels 2024-07-23 17:24:40 +08:00
Marvin Zhang
96ba586cd2 refactor: Update dependencies and remove unused code 2024-07-13 11:16:17 +08:00
Marvin Zhang
ffcb44ff9e chore: updated deps 2024-07-02 10:22:32 +08:00
Marvin Zhang
3385caf972 chore: updated deps 2024-07-02 09:51:47 +08:00
Marvin Zhang
7ca98f9142 chore: updated deps 2024-07-02 09:48:40 +08:00
Marvin Zhang
1ea0a352c4 chore: updated deps 2024-06-29 22:30:56 +08:00
Marvin Zhang
1eb81b3f43 feat: finalized git progress for clone, pull, push
https://github.com/crawlab-team/crawlab/issues/1485
2024-06-29 22:29:34 +08:00
Marvin Zhang
0b3fbcfed8 feat: added multi-spider in git
https://github.com/crawlab-team/crawlab/issues/1485
2024-06-28 18:52:49 +08:00
Marvin Zhang
73a5a64ba4 fix: notification issue 2024-06-26 13:18:28 +08:00
Marvin Zhang
9d21bad931 fix: file upload issue 2024-06-18 18:16:26 +08:00
Marvin Zhang
3727ea6970 fix: deps issue 2024-06-17 17:30:23 +08:00
Marvin Zhang
08d9f4f676 feat: updated grpc proto 2024-06-14 19:24:09 +08:00
Marvin Zhang
14394fa72d fix: dependency issue 2024-06-14 17:58:42 +08:00
Marvin Zhang
7b4ee8399a fix: dependency issue 2024-06-14 17:52:18 +08:00
Marvin Zhang
de987f7f12 fix: dependency issue 2024-06-14 17:47:30 +08:00
Marvin Zhang
0834d6771b fix: dependency issue 2024-06-14 17:32:56 +08:00
Marvin Zhang
27f2e42116 fix: dependency issue 2024-06-14 16:51:09 +08:00
Marvin Zhang
6a60433d25 feat: added modules 2024-06-14 16:37:48 +08:00
Marvin Zhang
dc21bce11f feat: added modules 2024-06-14 15:59:48 +08:00
Marvin Zhang
0b67fd9ece feat: added modules 2024-06-14 15:42:50 +08:00