FeatureFuel
12

Regarding the Studio AI Assistant and Local LLMs

Source: supabase/supabase#22014 · opened by @jpaveg
I was wondering if there are plans to support being able to connect to something like lmstudio, which can host a server that mimics the openai api.

Please let me know if I'm misunderstanding this, but would reading the environment variable OPENAI_BASE_URL and overriding the one used in each instantiation of the openAI client (const openai = new OpenAI({ apiKey: openAiKey, base_url: baseUrl })) allow this to work?

I would appreciate any insight offered.

No pledges yet. Be the first to back this.

Make a pledge

Pledge your monetary support if this feature is added.

$

Comments

No comments yet.

Replying to

Add a comment

What do you think about this feature request?


Similar requests