public/immich
1
0
Fork 0
mirror of https://github.com/immich-app/immich.git synced 2025-11-16 06:02:35 +09:00
Code Issues Actions 7 Packages Projects Releases Wiki Activity

feat(ml): coreml (#17718)
Some checks failed
CodeQL / Analyze (javascript) (push) Has been cancelled
Details
CodeQL / Analyze (python) (push) Has been cancelled
Details
Docker / pre-job (push) Has been cancelled
Details
Docker / Re-Tag ML () (push) Has been cancelled
Details
Docker / Re-Tag ML (-armnn) (push) Has been cancelled
Details
Docker / Re-Tag ML (-cuda) (push) Has been cancelled
Details
Docker / Re-Tag ML (-openvino) (push) Has been cancelled
Details
Docker / Re-Tag ML (-rknn) (push) Has been cancelled
Details
Docker / Re-Tag ML (-rocm) (push) Has been cancelled
Details
Docker / Re-Tag Server () (push) Has been cancelled
Details
Docker / Build and Push ML (armnn, linux/arm64, -armnn) (push) Has been cancelled
Details
Docker / Build and Push ML (cpu, ) (push) Has been cancelled
Details
Docker / Build and Push ML (cuda, linux/amd64, -cuda) (push) Has been cancelled
Details
Docker / Build and Push ML (openvino, linux/amd64, -openvino) (push) Has been cancelled
Details
Docker / Build and Push ML (rknn, linux/arm64, -rknn) (push) Has been cancelled
Details
Docker / Build and Push ML (rocm, linux/amd64, {"linux/amd64": "mich"}, -rocm) (push) Has been cancelled
Details
Docker / Build and Push Server (push) Has been cancelled
Details
Docker / Docker Build & Push Server Success (push) Has been cancelled
Details
Docker / Docker Build & Push ML Success (push) Has been cancelled
Details
Docs build / pre-job (push) Has been cancelled
Details
Docs build / Docs Build (push) Has been cancelled
Details
Zizmor / Zizmor (push) Has been cancelled
Details
Static Code Analysis / pre-job (push) Has been cancelled
Details
Static Code Analysis / Run Dart Code Analysis (push) Has been cancelled
Details
Test / pre-job (push) Has been cancelled
Details
Test / Test & Lint Server (push) Has been cancelled
Details
Test / Unit Test CLI (push) Has been cancelled
Details
Test / Unit Test CLI (Windows) (push) Has been cancelled
Details
Test / Lint Web (push) Has been cancelled
Details
Test / Test Web (push) Has been cancelled
Details
Test / Test i18n (push) Has been cancelled
Details
Test / End-to-End Lint (push) Has been cancelled
Details
Test / Medium Tests (Server) (push) Has been cancelled
Details
Test / End-to-End Tests (Server & CLI) (ubuntu-24.04-arm) (push) Has been cancelled
Details
Test / End-to-End Tests (Server & CLI) (ubuntu-latest) (push) Has been cancelled
Details
Test / End-to-End Tests (Web) (ubuntu-24.04-arm) (push) Has been cancelled
Details
Test / End-to-End Tests (Web) (ubuntu-latest) (push) Has been cancelled
Details
Test / End-to-End Tests Success (push) Has been cancelled
Details
Test / Unit Test Mobile (push) Has been cancelled
Details
Test / Unit Test ML (push) Has been cancelled
Details
Test / .github Files Formatting (push) Has been cancelled
Details
Test / ShellCheck (push) Has been cancelled
Details
Test / OpenAPI Clients (push) Has been cancelled
Details
Test / SQL Schema Checks (push) Has been cancelled
Details
CLI Build / CLI Publish (push) Has been cancelled
Details
CLI Build / Docker (push) Has been cancelled
Details

Browse Source 
* coreml

* add test

* use arena by default in native installation

* fix tests

* add env to docs

* remove availability envs
This commit is contained in:
Mert
2025-10-14 13:51:31 -04:00
committed by GitHub
parent 43eccca86a
commit 1b62c2ef55
6 changed files with 47 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
machine-learning/immich_ml/sessions/ort.py
View File

@@ -96,6 +96,14 @@ class OrtSession:
"precision": "FP32",
"cache_dir": (self.model_path.parent / "openvino").as_posix(),
}
case "CoreMLExecutionProvider":
options = {
"ModelFormat": "MLProgram",
"MLComputeUnits": "ALL",
"SpecializationStrategy": "FastPrediction",
"AllowLowPrecisionAccumulationOnGPU": "1",
"ModelCacheDirectory": (self.model_path.parent / "coreml").as_posix(),
}
case _:
options = {}
provider_options.append(options)
@@ -115,7 +123,7 @@ class OrtSession:
@property
def _sess_options_default(self) -> ort.SessionOptions:
sess_options = ort.SessionOptions()
sess_options.enable_cpu_mem_arena = False
sess_options.enable_cpu_mem_arena = settings.model_arena
# avoid thread contention between models
if settings.model_inter_op_threads > 0: