1
[Feature] Upgrade to ONNX Runtime 1.27.0 for official CUDA 13 support
Source: immich-app/immich#29491 · opened by @altheali533
I have searched the existing feature requests, both open and closed, to make sure this is not a duplicate request. • Yes The feature I have searched the existing feature requests to make sure this is not a duplicate request. Yes The feature ONNX Runtime v1.27.0 was just released and it's a significant milestone for CUDA 13 support: • Support for CUDA 12 is being removed starting in 1.27.0 • CUDA 13 is now published as a stable package: onnxruntime-<os>-<arch>-gpu_cuda13-<version> • onnxruntime-gpu 1.27.0 wheels for CUDA 13 are already live on PyPI Release notes: Previously, the blocker for Immich adding CUDA 13 support was that onnxruntime only had CUDA 13 as an unstable nightly build (no official stable release). That blocker is now resolved. Immich's machine-learning/Dockerfile currently builds the CUDA image from nvidia/cuda:12.2.2-runtime-ubuntu22.04, which causes failures for users running newer NVIDIA d…
No pledges yet. Be the first to back this.
Comments
Similar requests
[Feature] Support for arm64 for CUDA (immich-machine-learning)
41 votes · 0 comments
[Feature] Support for Qualcomm NPU Hardware Acceleration (QNN Execution Provider)
3 votes · 0 comments
[Feature] DirectML execution provider for Machine Learning (AMD GPU Support on Windows/WSL2)
8 votes · 0 comments
[Feature] Custom base URL for ONNX files
1 vote · 0 comments
[Feature] Apple Container and CoreML Support for Machine Learning
16 votes · 0 comments
No comments yet.