FeatureFuel
5

[Feature Request] Optimize AI suggestion generation

Source: paperless-ngx/paperless-ngx#13056 · opened by @marfrh
Description Right now in v3 beta, AI suggestion generation (title, category, tags, ...) will include additional context chunks from similar documents if an embedding model is configured. The prompt built with RAG looks like this: From my understanding, the goal is to improve generation of titles, tags, and other metadata by adding RAG context. However, metadata (such as tags or correspondents) of these additional documents is not included in the prompt. As a result, the LLM has to guess this information. Besides increased processing time, this also likely leads to outputs that do not match the existing metadata (e.g. tags or correspondents) of the similar documents. I would like to suggest the following improvements: • A) Option to disable additional context from similar documents This could reduce processing time significantly (in my case by up to 110s, depending on size/similar docs, using an RTX A2000 12 GB GPU). • B) Replace or complement RAG chunks …

No pledges yet. Be the first to back this.

Make a pledge

Pledge your monetary support if this feature is added.

$

Comments

No comments yet.

Replying to

Add a comment

What do you think about this feature request?


Similar requests