A unified interface to seamlessly access and switch between various Large Language Models from different providers.
The LLM Gateway is a unified API that lets you access multiple Large Language Models through a single endpoint. Switch between models from different providers with just a parameter change.
Replace your OpenAI base URL with ZeroEval’s gateway and use model names directly:
Copy
Ask AI
from openai import OpenAI# Initialize the client with ZeroEval APIclient = OpenAI( api_key="YOUR_API_KEY", base_url="https://api.zeroeval.com/v1",)# Make a completion requestresponse = client.chat.completions.create( model="gpt-4o", # Just the model name, no provider prefix messages=[ {"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": "Hello, how are you?"}, ],)print(response.choices[0].message.content)