Braintrust Integration
Braintrust is an enterprise AI product stack that includes evaluation, logging, and a proxy for LLM applications. Its AI proxy provides caching, rate limiting, and unified access to multiple providers.
Braintrust's proxy can be configured to route requests to LLM API.
INFO
No code changes needed: Observability can send a trace of every request
straight from LLM API to Braintrust — connect it once in the dashboard. The setup below traces
calls from inside your application instead.
Prerequisites
- An LLM API account with an API key
- Braintrust installed or accessible
Setup
Get Your LLM API Key
- Log in to your LLM API dashboard
- Click Create Key to Start
- Copy your new API key immediately — it will only be shown once
- Store the key securely (e.g., in a password manager or
.env file)
INFO
LLM API is an OpenAI-compatible gateway that gives you access to dozens of AI models through a
single API key and endpoint.
Configure LLM API with Braintrust Proxy
- Configure environment variables:
export OPENAI_API_KEY="your-llm-api-key-here"
export OPENAI_BASE_URL="https://api.llmapi.ai/v1"
- Or configure in Braintrust's project settings to use LLM API as a provider.
- Braintrust will log and evaluate all LLM API interactions.
Test the Integration
Verify that Braintrust can successfully communicate with LLM API by sending a test request. All requests will now be routed through LLM API.
INFO
Braintrust's evaluation tools help you measure and improve your LLM API application's quality.
Benefits of Using LLM API with Braintrust
- Multi-Provider Access: Use models from OpenAI, Anthropic, Google, and more through a single API
- Cost Control: Track and limit your AI spending with detailed usage analytics
- Unified Billing: One account for all providers instead of managing multiple API keys
- Caching: Reduce costs with response caching for repeated requests
INFO
View all available models on the models page.