34
[Feature] Support Hailo for machine learning hardware acceleration
Source: immich-app/immich#17230 · opened by @arthurmcgregor
I have searched the existing feature requests, both open and closed, to make sure this is not a duplicate request. • Yes The feature I run Immich on a Raspberry Pi 5 and would like to connect a Raspberry Pi AI Hat to improve machine learning performance. From what I understand, this would require supporting the Hailo modules for hardware acceleration. I suspect the Raspberry Pi 5 is a common entrypoint for people starting on their self-hosting journey (like myself!) so supporting the RPi AI hardware would be valuable. The relevant hardware is currently: • [AI HAT]( with "13 and 26 tera-operations per second (TOPS) variants, built around the Hailo-8L and Hailo-8 neural network inference accelerators" • [AI Kit]( with "13 tera-operations per second (TOPS) neural network inference accelerator built around the Hailo-8L chip." There was a related discussion [here]( but that discussion is closed and the Hailo part was a side-discussion, so o…
No pledges yet. Be the first to back this.
Comments
Similar requests
[Feature] Rusticl Support for Machine Learning Hardware Acceleration
1 vote · 0 comments
[Feature] DirectML execution provider for Machine Learning (AMD GPU Support on Windows/WSL2)
8 votes · 0 comments
[Feature] Separate Image Preview for Machine Learning
1 vote · 0 comments
Improve machine learning resilience in low VRAM scenarios (CUDA)
1 vote · 0 comments
[Feature] Support for arm64 for CUDA (immich-machine-learning)
41 votes · 0 comments
No comments yet.