Commit Graph

  • cd2890e395 docs(memory_system): clarify memory operation definitions and update processing guidelines Refine CREATE, UPDATE, DELETE, and SKIP operation descriptions to emphasize lasting relevance, entity resolution, and stricter criteria for updates and skips. Remove redundant guideline on retroactive enrichment and clarify when to use each operation, improving precision and selectivity in memory handling. main mtayfur 2025-12-02 21:19:29 +03:00
  • 879ea8a28d refactor(memory_system): remove skip state cache and threshold from retrieval, unify skip logic for inlet and outlet Skip state caching is eliminated to simplify state management, and skip logic is now handled directly in both inlet and outlet, improving clarity and reducing redundant cache usage; retrieval threshold is no longer returned in API responses, and skip reasons are separated for retrieval and consolidation to provide more precise status messaging. mtayfur 2025-11-29 12:31:06 +03:00
  • e97137bb4c feat(memory_system): enhance memory consolidation with multi-message context and semantic deduplication optimizations mtayfur 2025-11-29 00:56:17 +03:00
  • 5bf5f775f4 feat(memory_system): refine memory limits, prompt guidelines, and skip detection for improved clarity and relevance mtayfur 2025-11-26 20:58:27 +03:00
  • 308cf1285e refactor(SkipDetector): optimize line structure handling and reduce redundant splits Refactors the skip detection logic to precompute and reuse line splits and non-empty line lists, reducing repeated operations and improving efficiency and readability, while also fixing edge cases for empty messages and ensuring more robust pattern detection. mtayfur 2025-11-26 16:59:54 +03:00
  • 59ff55d662 docs(memory_system): clarify example outputs and explanations for memory operations Improves clarity in example 3 by specifying the origin city in the CREATE operation for more complete context, and updates example 6 to better reflect the distinction between technical requests and personal statements, ensuring the documentation accurately guides memory handling logic. mtayfur 2025-11-26 16:45:07 +03:00
  • 75e460c548 style(memory_system): add emoji to log messages and improve docstrings for clarity mtayfur 2025-11-26 16:02:25 +03:00
  • 7055eb42f2 refactor(memory_system): unify status level constants, improve log clarity, and adjust thresholds for better maintainability and diagnostics Status level constants are consolidated into a single STATUS_LEVEL dict for easier access and reduced redundancy, log messages are clarified and made more concise for better diagnostics, and threshold multipliers are adjusted to fine-tune memory retrieval and reranking behavior. These changes improve code maintainability, readability, and operational transparency. mtayfur 2025-11-26 15:55:29 +03:00
  • 0c87a815fc refactor(memory_system): streamline memory deduplication, logging, and message extraction logic Refactors deduplication to batch embedding generation for efficiency, consolidates user message extraction into a helper for reuse, replaces statistics.median with numpy for consistency, simplifies memory operation execution, and removes redundant logging and unused imports to improve maintainability and performance. mtayfur 2025-11-26 10:47:16 +03:00
  • cdedeee6ba fix(memory_system): improve content extraction, hash handling, and memory filtering Updates content extraction logic for robustness, ensures all hash operations handle non-string input safely, filters out empty memory content, and bumps required Open WebUI version for compatibility. These changes address edge cases in content processing, prevent potential errors, and ensure only valid memories are processed and embedded. mtayfur 2025-11-26 01:04:48 +03:00
  • 4502e07fb3 chore(memory_system): bump version to 1.2.0 in metadata header v1.2.0 mtayfur 2025-11-24 16:06:03 +03:00
  • bc5611a6d0 refactor(memory_system): simplify embedding normalization, memory retrieval, and response decoding logic Redundant checks and exception handling are removed to streamline code paths, making embedding normalization, user memory retrieval, and LLM response decoding more concise and maintainable while preserving error propagation at higher levels. mtayfur 2025-11-24 15:59:55 +03:00
  • 3b84f64392 refactor: make skip detection and embedding operations fully async for improved concurrency mtayfur 2025-11-24 15:45:03 +03:00
  • 960f8ce4a9 feat(memory_system): introduce "Intermediate" status level for more granular status emission control mtayfur 2025-11-15 21:51:22 +03:00
  • 6ae99d4778 refactor(memory): remove redundant valve options and clarify reranking controls mtayfur 2025-11-09 15:55:27 +03:00
  • c77237a651 feat(memory_system): make skip category margin configurable via Filter settings Allowing skip_category_margin to be set in Filter enables dynamic adjustment of skip detection sensitivity, improving flexibility for different deployment scenarios. mtayfur 2025-11-09 15:43:30 +03:00
  • aaaf848c1e refactor(memory_system): remove "Intermediate" status level and update status emission logic Eliminates the "Intermediate" status level for message verbosity, consolidating to "Basic" and "Detailed" for clarity and simplicity; updates all related mappings, enums, and status emission calls to reflect this streamlined approach, reducing confusion and improving maintainability. mtayfur 2025-11-09 14:31:27 +03:00
  • cfc4dca6fc feat(memory_system): expand skip and personal category descriptions and improve skip state caching logic mtayfur 2025-11-07 17:43:58 +03:00
  • ff6052fd41 feat(memory_system): add configurable status message verbosity levels mtayfur 2025-11-07 00:19:50 +03:00
  • eca65fef43 fix: increase SKIP_CATEGORY_MARGIN for skip category classification to 0.15 The SKIP_CATEGORY_MARGIN constant is raised from 0.10 to 0.15 to make skip category classification more selective, reducing false positives by requiring a higher margin above personal similarity. mtayfur 2025-11-04 01:45:26 +03:00
  • 8997f71f05 refactor(memory_system): remove excessive try/except and input validation, streamline async operations, and add skip state cache mtayfur 2025-10-28 17:51:09 +03:00
  • 8ced9aace5 feat(skip-detection): expand and reorganize non-personal category descriptions for improved coverage and clarity mtayfur 2025-10-28 17:23:20 +03:00
  • 577f6d6406 Enhance skip detection logic with additional checks for structured content and code indicators v1.1.0 mtayfur 2025-10-28 03:44:26 +03:00
  • fe3c47f6e4 Update README and logging messages for model configuration clarity mtayfur 2025-10-28 03:03:11 +03:00
  • 551b0c571b ♻️ Skip detection now binary (#4) M. Tayfur 2025-10-28 02:35:29 +03:00
  • e6e3f7ab99 Merge pull request #3 from GlisseManTV/dev M. Tayfur 2025-10-27 23:39:06 +03:00
  • cca8079b94 Fix formatting and add metadata to memory_system.py iTConsult4Care 2025-10-27 21:14:35 +01:00
  • 55a8c70bac add suppport of current chat model GlissemanTV 2025-10-27 21:06:35 +01:00
  • e12aa7b776 Merge branch 'dev' of https://github.com/GlisseManTV/openwebui-memory-system into dev GlissemanTV 2025-10-27 21:05:26 +01:00
  • b5a4872096 📝 (memory_system): clarify and strengthen intent filtering and memory consolidation guidelines mtayfur 2025-10-27 00:57:26 +03:00
  • 3f9b4c6d48 ♻️ (memory_system): refactor skip detection and add semantic deduplication mtayfur 2025-10-26 23:31:37 +03:00
  • bb1bd01222 ♻️ (memory_system.py): reformat code for consistency, readability, and maintainability mtayfur 2025-10-27 00:20:35 +03:00
  • 189c6d4226 🔧 (dev-check.sh, pyproject.toml, requirements.txt): add development tooling and configuration mtayfur 2025-10-27 00:18:26 +03:00
  • 7630259ce1 Delete memory_system_ollama.py iTConsult4Care 2025-10-26 16:48:26 +01:00
  • a3a627339a Merge branch 'dev' of https://github.com/GlisseManTV/openwebui-memory-system into dev GlissemanTV 2025-10-26 16:46:06 +01:00
  • 390747c1d1 Delete memory_system_ollama.py iTConsult4Care 2025-10-26 16:45:30 +01:00
  • b6b4c5fde8 Add files via upload iTConsult4Care 2025-10-26 16:44:24 +01:00
  • 4328e4b79c Add current model usecase iTConsult4Care 2025-10-26 16:42:36 +01:00
  • fcae27e840 add current model usecase GlissemanTV 2025-10-26 16:14:05 +01:00
  • 1f779d86ec Merge branch 'dev' of https://github.com/GlisseManTV/openwebui-memory-system into dev GlissemanTV 2025-10-26 16:12:12 +01:00
  • d07a853aeb add current model using case GlissemanTV 2025-10-26 16:05:35 +01:00
  • 89399f57cc add current model workflow with checkbox GlissemanTV 2025-10-26 16:01:13 +01:00
  • c0bfb3927b Refactor memory creation guidelines for improved clarity and conciseness in contextual completeness section. mtayfur 2025-10-19 05:13:45 +03:00
  • d05ed8a16e Update semantic retrieval thresholds in Constants class for improved accuracy mtayfur 2025-10-18 20:31:04 +03:00
  • 7e2209633d Refactor logger initialization in memory_system.py to use module name for better context in log messages. mtayfur 2025-10-18 19:25:22 +03:00
  • 505c443050 Update README.md to enhance clarity on privacy and cost considerations; restructure sections for better readability and add relevant details. mtayfur 2025-10-15 14:33:33 +03:00
  • 0726293446 Update README.md for improved clarity and accuracy; revise privacy notice, cache descriptions, and model support details. mtayfur 2025-10-15 14:13:55 +03:00
  • e3709fe677 Refactor cache management in Filter class; reduce maximum cache entries and concurrent user caches for improved performance and clarity. Update cache management methods for consistency and better logging. mtayfur 2025-10-15 14:05:01 +03:00
  • 2deba4fb2c Refactor Filter class to use async for pipeline context setup; implement locking mechanism for shared skip detector cache to enhance concurrency safety. mtayfur 2025-10-12 23:24:58 +03:00
  • 849dd71a01 Refactor memory selection logic in LLMRerankingService for improved clarity; streamline response handling by directly using response.ids. mtayfur 2025-10-12 23:03:36 +03:00
  • 158f0d1983 Refactor memory operations in Filter class for improved readability and consistency; utilize statistics.median for score calculation and streamline operation details formatting. mtayfur 2025-10-12 22:54:18 +03:00
  • 2db2d3f2c8 Refactor SkipDetector to streamline skip detection logic and improve clarity; update method signature for better integration with memory system. mtayfur 2025-10-12 21:44:51 +03:00
  • 1390505665 Refactor SkipDetector to use a callable embedding function instead of SentenceTransformer; update requirements to remove unnecessary dependencies. v1.0.0 mtayfur 2025-10-09 23:36:27 +03:00
  • 08155816ff add memory_system_ollama.py GlissemanTV 2025-10-10 09:10:03 +02:00
  • 840d4c59ca Refactor SkipDetector to use a callable embedding function instead of SentenceTransformer; update requirements to remove unnecessary dependencies. mtayfur 2025-10-09 23:36:27 +03:00
  • 5c0ca1f4ab Update model loading to use 'auto' device for SentenceTransformer, enhancing compatibility across environments. mtayfur 2025-10-09 21:50:17 +03:00
  • 86de7bad03 Add README.md to document the Memory System for Open WebUI, detailing core features, model support, configuration options, performance optimizations, and memory quality management. mtayfur 2025-10-09 14:19:57 +03:00
  • 6820ef9dcd Refactor SkipDetector category descriptions for enhanced clarity and specificity, improving technical accuracy and readability across various categories. mtayfur 2025-10-09 13:43:44 +03:00
  • e89a9b29b9 Refactor cache configuration constants for improved clarity and consistency; adjust cache entry limits and hash prefix length mtayfur 2025-10-09 13:10:58 +03:00
  • 74f7ededcd Refactor memory retrieval logging to include retrieval method, enhancing clarity in LLM and semantic decision processes mtayfur 2025-10-09 11:41:20 +03:00
  • bb992906ad Refactor LLM analysis logging and status emissions for improved clarity and accuracy in memory retrieval processes mtayfur 2025-10-09 11:33:50 +03:00
  • 765408cea4 Refactor SkipDetector category descriptions for improved clarity and specificity, enhancing semantic classification and detection accuracy across technical, instruction, math, translation, grammar, and conversational categories. mtayfur 2025-10-06 17:06:29 +03:00
  • 50c38f39d1 Refactor SkipDetector category descriptions for enhanced clarity and specificity, updating technical and personal context entries to improve semantic classification and detection accuracy. mtayfur 2025-10-06 14:34:48 +03:00
  • 34d11a3be6 Implement code changes to enhance functionality and improve performance mtayfur 2025-10-06 12:18:45 +03:00
  • 7c495adca5 Refactor SkipDetector category descriptions for improved clarity and specificity, consolidating meta instruction and factual query categories into a single instruction category, enhancing semantic classification and detection accuracy. mtayfur 2025-10-06 03:03:19 +03:00
  • 9a5c6b8f58 Refactor SkipDetector category descriptions for enhanced specificity and clarity, improving semantic classification and detection accuracy. mtayfur 2025-10-06 02:24:59 +03:00
  • 5c91a53ded Enhance SkipDetector category descriptions by adding new entries for debugging, CI/CD, translation, and personal context, improving detection capabilities and coverage. mtayfur 2025-10-06 01:10:49 +03:00
  • 05e75d1991 Refactor SkipDetector category descriptions for improved clarity and specificity, updating meta conversation to meta instruction and enhancing technical detection logic mtayfur 2025-10-05 23:43:44 +03:00
  • 826cd6abf7 Refactor SkipDetector category descriptions for clarity and conciseness, enhancing semantic classification accuracy mtayfur 2025-10-05 21:21:46 +03:00
  • c98809f807 Refactor SkipDetector to remove creative fiction and roleplay categories, streamlining skip detection logic mtayfur 2025-10-05 21:08:15 +03:00
  • 2c9e7141b3 Refactor SkipDetector category descriptions for clarity and conciseness mtayfur 2025-10-05 20:50:17 +03:00
  • a13302e0b5 Refactor SkipDetector to enhance skip detection patterns and add new categories for pure math, translation, grammar, fiction, and roleplay mtayfur 2025-10-05 16:32:59 +03:00
  • f00e25bf44 Refactor Filter class to improve error handling for empty text inputs and optimize embedding cache logic mtayfur 2025-10-05 10:58:38 +03:00
  • c3d6a36f2a Update duration threshold for memory retrieval logging to improve accuracy mtayfur 2025-10-05 00:14:04 +03:00
  • 03a5388c5e Enhance SkipDetector with fast-path detection for technical messages and add confident margin for early skips mtayfur 2025-10-04 22:29:36 +03:00
  • 70daca777f Refactor SkipDetector logging to simplify message output for skipped messages mtayfur 2025-10-03 23:21:20 +03:00
  • d9409c2aee Add logging and status emission for cases with no relevant memories found mtayfur 2025-10-03 23:00:42 +03:00
  • 75f48a4112 Enhance SkipDetector with additional skip categories and descriptions for improved message handling mtayfur 2025-10-03 22:41:52 +03:00
  • e546a1508d Refactor Filter class configuration fields for clarity and redundancy removal mtayfur 2025-10-03 21:30:22 +03:00
  • 1980461f22 Initial commit mtayfur 2025-10-03 21:24:22 +03:00