5
[Feature Request] Optimize AI suggestion generation
Source: paperless-ngx/paperless-ngx#13056 · opened by @marfrh
Description Right now in v3 beta, AI suggestion generation (title, category, tags, ...) will include additional context chunks from similar documents if an embedding model is configured. The prompt built with RAG looks like this: From my understanding, the goal is to improve generation of titles, tags, and other metadata by adding RAG context. However, metadata (such as tags or correspondents) of these additional documents is not included in the prompt. As a result, the LLM has to guess this information. Besides increased processing time, this also likely leads to outputs that do not match the existing metadata (e.g. tags or correspondents) of the similar documents. I would like to suggest the following improvements: • A) Option to disable additional context from similar documents This could reduce processing time significantly (in my case by up to 110s, depending on size/similar docs, using an RTX A2000 12 GB GPU). • B) Replace or complement RAG chunks …
No pledges yet. Be the first to back this.
Comments
Similar requests
[Feature Request] Automatically suggest non-LLM suggestions when editing documents, like in versions before 3.0.0
15 votes · 0 comments
[Feature Request] Allow workflow actions to wait for AI suggestions to be applied
1 vote · 0 comments
[Feature Request] AI Suggestions Cache
6 votes · 0 comments
Disable "Apply AI suggestions" workflow action on documents with no content
1 vote · 0 comments
[Feature Request] Scoped style/instruction customization for AI suggestion prompts
1 vote · 0 comments
No comments yet.