git-sync/openwebui-memory-system
1
0
Fork 0
mirror of https://github.com/mtayfur/openwebui-memory-system.git synced 2026-01-22 15:01:02 +01:00
Code Issues Packages Projects Releases Wiki Activity

Update model loading to use 'auto' device for SentenceTransformer, enhancing compatibility across environments.

Browse Source
This commit is contained in:
mtayfur
2025-10-09 21:50:17 +03:00
parent 86de7bad03
commit 5c0ca1f4ab
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
memory_system.py
View File

@@ -1096,7 +1096,7 @@ class Filter:
self._skip_detector = _SHARED_MODEL_CACHE[model_key]["skip_detector"]
else:
logger.info(f"🤖 Loading embedding model: {model_key} (cache has {len(_SHARED_MODEL_CACHE)} models)")
self._model = SentenceTransformer(self.valves.embedding_model, device="cpu", trust_remote_code=True)
self._model = SentenceTransformer(self.valves.embedding_model, device="auto", trust_remote_code=True)
self._skip_detector = SkipDetector(self._model)
_SHARED_MODEL_CACHE[model_key] = {
"model": self._model,