1
Prometheus metrics for the machine-learning service
Source: immich-app/immich#31734 · opened by @lightsabit
The monitoring docs note that only the server container currently uses IMMICH_TELEMETRY_INCLUDE — any chance the machine-learning service could get metrics too? /metrics on the ML container just 404s (tried on the current release image; there's no prometheus client in it at all).
It would be really useful. ML is the part that eats the GPU, and when thumbnails or facial recognition are running slow I currently have no way to tell whether it's inference latency, a pile-up of requests, or models being loaded. Request duration and counts, queue depth, maybe which models are currently loaded — that's the graph I'm missing.
If this is welcome I'd be happy to try a PR. Something like a MACHINE_LEARNING_METRICS setting (the ML config already uses the MACHINE_LEARNING_ prefix) that turns on a simple metrics endpoint.
It would be really useful. ML is the part that eats the GPU, and when thumbnails or facial recognition are running slow I currently have no way to tell whether it's inference latency, a pile-up of requests, or models being loaded. Request duration and counts, queue depth, maybe which models are currently loaded — that's the graph I'm missing.
If this is welcome I'd be happy to try a PR. Something like a MACHINE_LEARNING_METRICS setting (the ML config already uses the MACHINE_LEARNING_ prefix) that turns on a simple metrics endpoint.
No pledges yet. Be the first to back this.
Comments
Similar requests
[Feature] Start all Immich metrics with word "immich_".
4 votes · 0 comments
[Feature] prometheus metric or api call: number of logged in users
3 votes · 0 comments
[Feature] (More) Prometheus metrics
8 votes · 0 comments
Return a clear 503 response when Smart Search cannot reach any ML server
1 vote · 0 comments
User quota doesn't include transcoded videos and thumbnails
1 vote · 0 comments
No comments yet.