PromptLayer Integration

PromptLayer is a prompt management and observability platform that helps teams create, version, evaluate, and monitor LLM prompts. It provides a visual editor for prompt engineering, A/B testing, and analytics to optimize AI application performance.

PromptLayer integrates with OpenAI-compatible APIs for prompt execution, allowing you to route requests through LLM API.

Prerequisites

An LLM API account with an API key
PromptLayer installed or accessible

Setup

Get Your LLM API Key

Log in to your LLM API dashboard
Click Create Key to Start
Copy your new API key immediately — it will only be shown once
Store the key securely (e.g., in a password manager or .env file)

LLM API is an OpenAI-compatible gateway that gives you access to dozens of AI models through a single API key and endpoint.

Configure LLM API in PromptLayer

Log in to your PromptLayer dashboard.
Navigate to Settings → Providers or API Keys.
Add a new provider and select "OpenAI" or "Custom OpenAI-Compatible".
Enter the following details:
- API Key: paste the key you copied from app.llmapi.ai/api-keys
- Base URL: https://api.llmapi.ai/v1
Click "Save" to store the configuration.
When creating or running prompts, select LLM API as the provider.

Test the Integration

Verify that PromptLayer can successfully communicate with LLM API by sending a test request. All requests will now be routed through LLM API.

PromptLayer will log and track all requests routed through LLM API, giving you full observability over your model usage.

Benefits of Using LLM API with PromptLayer

Multi-Provider Access: Use models from OpenAI, Anthropic, Google, and more through a single API
Cost Control: Track and limit your AI spending with detailed usage analytics
Unified Billing: One account for all providers instead of managing multiple API keys
Caching: Reduce costs with response caching for repeated requests

View all available models on the models page.