1
Add option to enable hardware acceleration for Adapter models
Source: supabase/supabase#39912 · opened by @kziovas
š§© Feature Request: Add option to enable hardware acceleration for Adapter models Summary: Enable users to specify the hardware device (cuda, cpu, mps, npu, etc.) used for computation when initializing adapter-based models such as TextEmbedding. --- Current Behavior Currently, the TextEmbedding adapter in vecs.adapters.text_embedding initializes a SentenceTransformer model without any control over which device is used for inference: This defaults to automatic device detection inside sentence-transformers, but users cannot explicitly override it or ensure that hardware acceleration (e.g., GPU or Apple MPS) is utilized when available. --- Proposed Improvement Add a new optional argument to the TextEmbedding class: and use it in model initialization: This aligns with the SentenceTransformer constructor signature: --- Benefits ⢠Improved performance: Enables GPU, MPS, or other accelerator usage for large-scale text embedding generation. ⢠Better control: Allowā¦
No pledges yet. Be the first to back this.
Comments
Similar requests
Add Storage Adapter For Chrome.Local.Storage Api
3 votes · 0 comments
Feature Request: Add Offline Sync Layer to Supabase Client (Offline Cache + Auto Sync + Conflict Resolution)
3 votes · 0 comments
Proposal: document AgentsKit as a portable Supabase pgvector adapter for JavaScript agents
1 vote · 0 comments
Enable customCryptoAdapter on create client
2 votes · 0 comments
Extend Model Support in Edge Runtime via Hugging Faceās Candle
2 votes · 0 comments
No comments yet.