FeatureFuel
1

[Feature] Upgrade to ONNX Runtime 1.27.0 for official CUDA 13 support

Source: immich-app/immich#29491 · opened by @altheali533
I have searched the existing feature requests, both open and closed, to make sure this is not a duplicate request. • Yes The feature I have searched the existing feature requests to make sure this is not a duplicate request. Yes The feature ONNX Runtime v1.27.0 was just released and it's a significant milestone for CUDA 13 support: • Support for CUDA 12 is being removed starting in 1.27.0 • CUDA 13 is now published as a stable package: onnxruntime-<os>-<arch>-gpu_cuda13-<version> • onnxruntime-gpu 1.27.0 wheels for CUDA 13 are already live on PyPI Release notes: Previously, the blocker for Immich adding CUDA 13 support was that onnxruntime only had CUDA 13 as an unstable nightly build (no official stable release). That blocker is now resolved. Immich's machine-learning/Dockerfile currently builds the CUDA image from nvidia/cuda:12.2.2-runtime-ubuntu22.04, which causes failures for users running newer NVIDIA d…

No pledges yet. Be the first to back this.

Make a pledge

Pledge your monetary support if this feature is added.

$

Comments

No comments yet.

Replying to

Add a comment

What do you think about this feature request?


Similar requests