The inference optimization OS

Keep the gold.
Lose the
gravel.

Sluice routes every AI request to the cheapest provider that can serve it, fails over when one goes down, and itemizes what every call cost, so you can optimize for what you pay per successful task, not per token.

One base_url change · drop-in API · 1 free credit, no card

LEDGERBATCHROUTESELECTTRIMCACHE
NOW PASSING · GATE 03 / 06
INTELLIGENT MODEL SELECTION

The smallest model in the right quality tier, only when you opt in with optimize: true.

Cost per success
the only number we optimize
=
total spend
incl. retries & failures
÷
tasks that passed
your quality bar, your evals
Why Sluice

The cheapest token is often the most expensive answer.

Marketplaces race to the lowest price per token. But a cheap model that fails half the time costs you retries, fallbacks and engineer hours. Sluice counts all of it.

Model X — cheapest per token
Cost per call
$0.40
Passes your eval
58%
Per success
$0.69
Model Y — Sluice's pick
ROUTED
Cost per call
$0.60
Passes your eval
95%
Per success
$0.63

Illustrative example. Your numbers come from your own traffic and evals.

Six gates · one channel

Every request passes through six gates.

Each gate removes a different kind of waste. Together they decide where, and whether, a request runs. Gates marked LIVE work today; the rest are on our roadmap.

04

Cheapest provider routingLIVE

Same model, many providers. Sluice takes the lowest live price that's up, and fails over when it isn't.

03

Intelligent model selectionLIVE

The smallest model in the right quality tier, only when you opt in with optimize: true.

02

Prompt & token optimizationROADMAP

Repeated context and bloated instructions are trimmed before they're billed. Same answer, fewer tokens.

01

Smart cachingLIVE

Identical repeats come back in milliseconds with no provider fee, and long repeated Claude prompts are cached automatically at a fraction of the price.

05

Batch inferenceLIVE

Not urgent? Send it to /v1/batches. It runs on the providers' batch capacity at half price and lands within 24 hours.

06

Quality & cost analyticsLIVE

Every attempt, retry and cent is logged against the request it belongs to. Proof, not promises.

Live channel

Watch a request find the cheapest open channel.

Real prices from our registry, simulated traffic. When a provider returns a 503, the request reroutes before your user notices.

POST /v1/chat/completions · model: … live routing simulation
Your appopenai sdkSLUICE OpenAIAnthropicGroqTogetherDeepInfraFireworks
    saved in this demo$0.000000 requests · 0 errors reached your app
    Same model, cheaper host
    up to 0%
    cheaper, after our fee
    Providers
    0
    14 models
    Prices compared
    0
    listings, on every request
    llama-3.3-70btogether $0.88deepinfra $0.16−62%llama-3.1-8btogether $0.18deepinfra $0.025−65%gpt-oss-120btogether $0.26deepinfra $0.070−55%gpt-oss-20btogether $0.088deepinfra $0.058−26%llama-3.3-70btogether $0.88deepinfra $0.16−62%llama-3.1-8btogether $0.18deepinfra $0.025−65%gpt-oss-120btogether $0.26deepinfra $0.070−55%gpt-oss-20btogether $0.088deepinfra $0.058−26%llama-3.3-70btogether $0.88deepinfra $0.16−62%llama-3.1-8btogether $0.18deepinfra $0.025−65%gpt-oss-120btogether $0.26deepinfra $0.070−55%gpt-oss-20btogether $0.088deepinfra $0.058−26%
    How it works

    Open the gate in an afternoon.

      1

      Point your base_url at Sluice

      Keep your code and your OpenAI SDK. Swap one line.

      2

      Add credit, create a key

      Prepaid and transparent: provider price plus 25% of what we save you. No saving, no fee.

      3

      Watch cost per request fall

      Every call is routed to the cheapest healthy provider and logged with what it cost and saved.

    app.py
    Pricing

    We only earn when you save.

    You pay the provider's price, plus 25% of whatever Sluice saves you against the direct price. If there's no saving, there's no fee, so Sluice is never more expensive than going direct. No subscription, no seats. Try it on your numbers:

    Workload

    You keep every month

    $0.00

    0% less · $0.00 a year

    Direct · openai gpt-4o$0.00
    Sluice · deepinfra gpt-oss-120b (optimized)$0.00

    464k requests × 1k input + 350 output tokens, at list prices from our model registry (checked 2026-11-02). Our side includes our fee: 25% of the saving, nothing if there is none.

    Open the gate.

    Point one service at Sluice, send real traffic, and read the receipt on every call before you switch the rest.