The LLM Gateway is a unified API that lets you access multiple Large Language Models through a single endpoint. Switch between models from different providers with just a parameter change.

Getting Started

1. Get Your API Key

Create an API key from your Settings → API Keys page.

2. Use the API

Replace your OpenAI base URL with ZeroEval’s gateway and use model names directly:
from openai import OpenAI

# Initialize the client with ZeroEval API
client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="https://api.zeroeval.com/v1",
)

# Make a completion request
response = client.chat.completions.create(
    model="gpt-4o", # Just the model name, no provider prefix
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Hello, how are you?"},
    ],
)

print(response.choices[0].message.content)

Available Models

Get a list of available models:
curl -X GET "https://api.zeroeval.com/v1/models" \
  -H "Authorization: Bearer YOUR_API_KEY"