Skip to main content

Kilo Gateway

The Universal Gateway for AI Inference

Route LLM requests to any provider, anywhere. Use Kilo Gateway to power your own apps, or bring your own keys to access models without a subscription.

1import { streamText } from 'ai'
2import { createOpenAI } from '@ai-sdk/openai'
3
4const kilo = createOpenAI({
5 baseURL: 'https://api.kilo.ai/api/gateway',
6 apiKey: process.env.KILO_API_KEY
7})
8
9const result = streamText({
10 model: kilo.chat('anthropic/claude-opus-4.8'),
11 prompt: 'Why is the sky blue?'
12})
and 500+ more

Why Kilo Gateway

The intelligent routing layer for all your AI inference needs

One endpoint, every provider, and full control over how requests get routed and paid for.

One API, Every Model

Unified access to top-tier models from Anthropic, OpenAI, Mistral, and more. Whether you are using Claude Opus 4.8 or a specialized open-source model, Kilo Gateway routes your request intelligently.

Flexible "Bring Your Own Key" (BYOK)

Don't want another subscription? No problem. Plug in your existing API keys (from providers like Z.ai or MiniMax) and use Kilo Gateway as your centralized infrastructure. Pay only for the routing, not the tokens.

Instant Access, No Friction

Start using the Gateway immediately with no barriers to entry. Use Kilo Gateway automatically inside IDE, CLI, and Cloud, or call it directly from your own apps via API.

Features for developers

Everything a production app needs from a model gateway: resilience, a standard integration surface, and visibility into routing decisions.

Robust Risk Management

Built-in abuse detection and heuristic checks protect your implementation from anomalous traffic patterns.

Standardized Integration

Drop-in compatible with standard AI SDKs (like Vercel AI SDK). Switch providers without rewriting your codebase.

High Availability

Our infrastructure handles the routing complexity, load balancing requests between direct providers and gateways like OpenRouter/Vercel to ensure maximum uptime.

Auto Model Routing

Route each request to the best model available while keeping routing decisions, spend, and model behavior visible and controllable.

Auto Model

Gateway is the model network. Auto Model is the router.

Kilo Gateway gives Auto Model access to the hosted catalog and routing surface. Kilo routes each task to the best model available while keeping the routing decision, spend, and model behavior visible and controllable.

Learn about Auto Model
Best available model
Full routing visibility
Manual control

Team & governance

Granular controls for teams, not just individuals

Enterprise provider configuration gives teams a concrete way to turn policy into day-to-day developer defaults. Admins can approve providers, restrict model access, and keep unsupported routes out of the engineering workflow.

Provider configuration screen showing model and provider access controls in Kilo

Routing Intelligence

Use Kilo Gateway to route requests across approved models and providers, with fallback paths and orchestration handled centrally.

Usage Insights

Track model usage, latency, spend, BYOK activity, and adoption across teams from one place.

Enterprise Controls

Approve providers, restrict model access, manage keys, and enforce identity controls so teams stay compliant without losing flexibility.

Pricing & Access Tiers

Flexible options to fit your needs, from a free tier to pay-as-you-go and Kilo Pass.

Free

Free

Perfect for getting started

$0/forever
  • Access to default free models
  • BYOK support
  • Basic analytics

Pay-As-You-Go

Pay-As-You-Go

For serious developers

Market rates
  • All models at market rates
  • No markup on BYOK
  • Advanced analytics
  • Priority support
  • Load balancing

Kilo Pass

Kilo Pass

Maximize your AI output per dollar.

From $19/month
  • A monthly AI token subscription
  • With up to 50% bonus credits included
  • Use anywhere: IDE, CLI, Cloud, and direct API access
  • Access to 500+ AI models

Get started in minutes

Three steps stand between you and routing production traffic through Kilo Gateway.

Step 1

Connect

Generate your Kilo Gateway key or input your own provider keys.

Step 2

Configure

Point your Kilo apps or external applications to our Gateway endpoint.

Step 3

Monitor

Gain insights into your model usage, latency, and costs through our unified dashboard.

Ready to start building with Kilo Gateway?

Get your API key in seconds and start routing requests today.

Built by Kilo Code

"Built by the engineering team at Kilo Code"

We use this Gateway to power our own high-performance coding tools. The same infrastructure that handles millions of requests for Kilo Code is now available to you.