3
[Feature] Support for Qualcomm NPU Hardware Acceleration (QNN Execution Provider)
Source: immich-app/immich#25112 · opened by @Dual-0
I have searched the existing feature requests, both open and closed, to make sure this is not a duplicate request. • Yes The feature Hi Immich Team, with the additions of RKNN and ARM NN support, I would like to propose adding support for Qualcomm NPUs via the ONNX Runtime [QNN Execution Provider]( This would benefit users running Immich on high-end Qualcomm-based SBCs like the [Radxa Dragon Q6A]( (QCS6490) or potentially Windows-on-ARM servers. Technical Details: • Target Backend: [QNNExecutionProvider]( • Requirement: [Qualcomm AI Runtime (QAIRT) SDK]( • Implementation Path: Similar to the current RKNN implementation with a specific Docker tag (e.g., -qnn) containing the onnxruntime-qnn build and the necessary shared libraries like libQnnHtp.so. • Reference: As linked above Radxa and Qualcomm have recently documented the process for building ONNX Runtime with QNN support for Linux Aarch64 targets. Benefits: The Qualcomm QCS6490 NPU i…
No pledges yet. Be the first to back this.
Comments
Similar requests
[Feature] Support Hailo for machine learning hardware acceleration
34 votes · 0 comments
[Feature] DirectML execution provider for Machine Learning (AMD GPU Support on Windows/WSL2)
8 votes · 0 comments
[Feature] HW acceleration on tegra-based hardware
2 votes · 0 comments
[Feature] Rusticl Support for Machine Learning Hardware Acceleration
1 vote · 0 comments
[Feature] Machine Learning using Intel NPU in OpenVINO on supported Core Ultra Processors
40 votes · 0 comments
No comments yet.