Skip to main content

Enable OpenAI Compatible APIs

Feature Request

Enable usage of OpenAI compatible endpoints. You only need to enable modifying 3 items:

  1. Base URL

  2. API Key

  3. Model ID

By default, OpenAI simply locks the BaseURL to their API. However, "OpenAI Compatible" basically just lets you swap the BaseURL in the API Calls. All other OpenAI API tool calls should be compatible, so there is in fact very little maintenance or up front configuration required.

In this way, it opens up BYOK to a plethora of other providers similar to OpenRouter (which I'm also shocked you don't support out of the box). This enables essentially any LLM gateway to be used with your product.

Some resources:
https://medium.com/@sudarshan-koirala/what-does-openai-api-compatible-actually-mean-aedfdf35e601
https://bentoml.com/llm/model-interaction/openai-compatible-api
https://developers.openai.com/api/reference/overview

Posted by Curtis Chow ·
Status: Completed1 comment

Log in to comment and vote

Comments1

  • Krishna - Remalt Dev

    •

    Jul 23

    Hey Curtis! This is now shipped 🎉 You can connect an OpenAI-compatible API from Settings → AI Models & API Keys using the Base URL, API key, and model ID. We’ll also discover available models when the provider supports it, or you can add model IDs manually.

    Small tradeoff compared with our native BYOK integrations: this relies on how closely each provider follows the OpenAI spec, so it’s currently focused on text generation. Provider-specific features like web search, tools, structured outputs, images, audio, and usage reporting aren’t guaranteed. Native integrations will still offer the most reliable provider-specific support.

    It uses your own provider balance and never consumes Remalt coins. Thanks for the detailed request!