💬OpenAI
Last updated
Last updated
Rasgo allows you to bring your own OpenAI API key to use for all LLM calls. The benefits of using your own API key are: faster access to new models, and ability to keep data in your own VPC (if deployed on Azure).
If you do not bring your own key, Rasgo will provide keys to communicate with OpenAI on your behal
API keys are set at your organization-level. All users in your organization will share this key. Rasgo supports one key per organization.
In the Admin Settings screen, navigate to the "AI Providers & Models" tab:
Click "Connect" on one of the supported LLM providers.
Enter all values in the modal, and your organization will be set to connect with your API key.
Next, you must set the models your organization will use for chat and text embeddings.
In the Admin Settings > "AI Providers & Models" tab:
Click "Add" to create a new model. Fill out all values in the modal to save models.
Create at least 1 chat model and 1 embedding model. If you add more than one chat model, users will be able to select from this list in their chat screens.
Every organization must have at least 1 chat model and 1 embedding model created to function properly.
Finally, select the models that will run as defaults for your organization. The default chat model will appear as the suggested model in all user's chats, but they will have the ability to override it.
Rasgo will always connect to your LLM provider from these IP addresses. Make sure to whitelist them if you're running a secure VPC.
52.22.246.61
