FeatureFuel
3

[Feature] Support for Qualcomm NPU Hardware Acceleration (QNN Execution Provider)

Source: immich-app/immich#25112 · opened by @Dual-0
I have searched the existing feature requests, both open and closed, to make sure this is not a duplicate request. • Yes The feature Hi Immich Team, with the additions of RKNN and ARM NN support, I would like to propose adding support for Qualcomm NPUs via the ONNX Runtime [QNN Execution Provider]( This would benefit users running Immich on high-end Qualcomm-based SBCs like the [Radxa Dragon Q6A]( (QCS6490) or potentially Windows-on-ARM servers. Technical Details: • Target Backend: [QNNExecutionProvider]( • Requirement: [Qualcomm AI Runtime (QAIRT) SDK]( • Implementation Path: Similar to the current RKNN implementation with a specific Docker tag (e.g., -qnn) containing the onnxruntime-qnn build and the necessary shared libraries like libQnnHtp.so. • Reference: As linked above Radxa and Qualcomm have recently documented the process for building ONNX Runtime with QNN support for Linux Aarch64 targets. Benefits: The Qualcomm QCS6490 NPU i…

No pledges yet. Be the first to back this.

Make a pledge

Pledge your monetary support if this feature is added.

$

Comments

No comments yet.

Replying to

Add a comment

What do you think about this feature request?


Similar requests