Enable OpenAI Compatible APIs

Enable usage of OpenAI compatible endpoints. You only need to enable modifying 3 items:

1. Base URL

2. API Key

3. Model ID

By default, OpenAI simply locks the BaseURL to their API. However, "OpenAI Compatible" basically just lets you swap the BaseURL in the API Calls. All other OpenAI API tool calls should be compatible, so there is in fact very little maintenance or up front configuration required.

In this way, it opens up BYOK to a plethora of other providers similar to OpenRouter (which I'm also shocked you don't support out of the box). This enables essentially any LLM gateway to be used with your product.

Some resources:
https://medium.com/@sudarshan-koirala/what-does-openai-api-compatible-actually-mean-aedfdf35e601
https://bentoml.com/llm/model-interaction/openai-compatible-api
https://developers.openai.com/api/reference/overview