Composio Integration

Composio is a platform that provides AI agents with access to 250+ tools and integrations. It connects to services like GitHub, Slack, Gmail, and databases, enabling agents to perform real-world actions across your tech stack.

Composio supports custom LLM providers for the AI agents powering its tool integrations.

Prerequisites

An LLM API account with an API key
Composio installed or accessible

Setup

Get Your LLM API Key

Log in to your LLM API dashboard
Click Create Key to Start
Copy your new API key immediately — it will only be shown once
Store the key securely (e.g., in a password manager or .env file)

LLM API is an OpenAI-compatible gateway that gives you access to dozens of AI models through a single API key and endpoint.

Configure LLM API in Composio

Install Composio and set up your workspace.
Configure the LLM provider:

export OPENAI_API_KEY="your-llm-api-key-here"
export OPENAI_BASE_URL="https://api.llmapi.ai/v1"

Or configure in code:

from composio_openai import ComposioToolSet
from openai import OpenAI
client = OpenAI(
api_key="your-llm-api-key-here",
base_url="https://api.llmapi.ai/v1"
)

Run your agents with Composio tools powered by LLM API.

Test the Integration

Verify that Composio can successfully communicate with LLM API by sending a test request. All requests will now be routed through LLM API.

Composio's tool integrations work with any OpenAI-compatible model through LLM API.

Benefits of Using LLM API with Composio

Multi-Provider Access: Use models from OpenAI, Anthropic, Google, and more through a single API
Cost Control: Track and limit your AI spending with detailed usage analytics
Unified Billing: One account for all providers instead of managing multiple API keys
Caching: Reduce costs with response caching for repeated requests

View all available models on the models page.