Jan Integration

Jan is an open-source desktop application that provides a ChatGPT-like interface for running AI models locally and connecting to remote APIs. It includes a built-in OpenAI-compatible API server and supports both local models (via llama.cpp) and cloud providers.

Jan supports remote OpenAI-compatible endpoints in addition to local models, letting you connect LLM API as a remote provider.

Prerequisites

An LLM API account with an API key
Jan installed or accessible

Setup

Get Your LLM API Key

Log in to your LLM API dashboard
Click Create Key to Start
Copy your new API key immediately — it will only be shown once
Store the key securely (e.g., in a password manager or .env file)

LLM API is an OpenAI-compatible gateway that gives you access to dozens of AI models through a single API key and endpoint.

Configure LLM API in Jan

Open Jan on your desktop.
Navigate to Settings (gear icon).
Under "Remote API" or "OpenAI" section, click to configure a remote provider.
Enter the following details:
- API Key: paste the key you copied from app.llmapi.ai/api-keys
- Base URL: https://api.llmapi.ai/v1
Enter or select the model ID you wish to use (e.g., openai/gpt-4o).
Click "Save" to store the configuration.
Select the remote model in the chat panel and start chatting through LLM API.

Test the Integration

Verify that Jan can successfully communicate with LLM API by sending a test request. All requests will now be routed through LLM API.

Jan lets you switch between local models and LLM API cloud models at any time, giving you the best of both worlds.

Benefits of Using LLM API with Jan

Multi-Provider Access: Use models from OpenAI, Anthropic, Google, and more through a single API
Cost Control: Track and limit your AI spending with detailed usage analytics
Unified Billing: One account for all providers instead of managing multiple API keys
Caching: Reduce costs with response caching for repeated requests

View all available models on the models page.