Have something to say?

Tell us how we could make the product more useful to you.

Completed

Enable OpenAI Compatible APIs

Enable usage of OpenAI compatible endpoints. You only need to enable modifying 3 items: Base URL API Key Model ID By default, OpenAI simply locks the BaseURL to their API. However, "OpenAI Compatible" basically just lets you swap the BaseURL in the API Calls. All other OpenAI API tool calls should be compatible, so there is in fact very little maintenance or up front configuration required. In this way, it opens up BYOK to a plethora of other providers similar to OpenRouter (which I'm also shocked you don't support out of the box). This enables essentially any LLM gateway to be used with your product. Some resources: https://medium.com/@sudarshan-koirala/what-does-openai-api-compatible-actually-mean-aedfdf35e601 https://bentoml.com/llm/model-interaction/openai-compatible-api https://developers.openai.com/api/reference/overview

Curtis Chow 21 days ago

1