1
[Feature Request] Outsource Local Inference into its own dedicated container to reduce the main image size
Source: paperless-ngx/paperless-ngx#13521 · opened by @Hutch79
Description The current docker image is ~2.46 GB extracted on disk. Compared to the v2 images (~1.42 GB), this is an increase of roughly 1 GB. Most of that seems to be the new AI feature which can run locally inside the container or remotely via Ollama or an OpenAI compatible API. Especially the local inference part seems to use ~810 MB (checked via image layers). Every installation pays for it, regardless if It's used or not, even though PAPERLESS_AI_ENABLED defaults to false. The problem I face The increase in storage needed generally hurts small scale deployments on e.g. cheap VPS offerings or older hardware like laptops (mine has a 128 GB SSD and a new one with the current marked is not an option). Suggestion: Drop the local inference backend from the main image and run inference as a separate container that Paperless talks to via API. This would reflect the way Immich handles AI workloads and has the additional benefit of giving users a first party possibility to …
No pledges yet. Be the first to back this.
Comments
Similar requests
[Feature Request] AI chat: size the synthesis prompts by context window, not embedding chunk size
3 votes · 0 comments
[Feature Request] Optimization of LLM query requests
1 vote · 0 comments
[Feature Request] Dynamically grant Superuser/Staff status to OIDC/SSO users based on group claims
4 votes · 0 comments
Minimum File Ingest Size [Feature Request]
1 vote · 0 comments
[Feature Request] Support ETSI ASiC-E signed documents (EU e-signed docs)
2 votes · 0 comments
No comments yet.