API Reference
Every THROUGHPUTS endpoint, parameter, and response shape.
The THROUGHPUTS API is OpenAI-compatible. If you've used the OpenAI API, you
already know how to use this one — change the base URL to
https://api.throughputs.dev/v1 and you're done.
Base URL
https://api.throughputs.dev/v1All endpoints below are appended to this base.
Endpoints
| Method | Path | Description |
|---|---|---|
POST | /chat/completions | Create a chat completion (streaming or batch). |
POST | /embeddings | Generate embeddings for input text. |
GET | /models | List all models your key can access. |
GET | /models/{slug} | Get details + pricing for a single model. |
GET | /pricing/plans | List available plans (pay-as-you-go, coding, bundle, enterprise). |
POST | /pricing/estimate | Estimate cost for a hypothetical workload. |
GET | /keys | List your API keys (without secrets). |
POST | /keys | Create a new API key. |
DELETE | /keys/{id} | Revoke a key. |
Common request headers
| Header | Required | Description |
|---|---|---|
Authorization | Yes | Bearer thp_live_xxx. |
Content-Type | Yes for POST | application/json. |
X-Throughputs-Model-Fallback | No | Comma-separated list of fallback models. If the primary model fails or times out, THROUGHPUTS tries each fallback in order. |
Common response fields
Every response includes these headers:
| Header | Description |
|---|---|
X-Throughputs-Model | The model that actually served the request (may differ from model in the request after failover). |
X-Throughputs-Provider | The upstream provider (e.g. openai, anthropic). |
X-Throughputs-Tokens-In | Prompt tokens billed. |
X-Throughputs-Tokens-Out | Completion tokens billed. |
X-Throughputs-Cost-Usd | Total cost in USD with 6 decimal places. |
Rate limits
Limits depend on your plan:
| Plan | Requests / min | Tokens / min |
|---|---|---|
| Pay-as-you-go | 60 | 100,000 |
| Coding | 200 | 500,000 |
| Bundle | 500 | 2,000,000 |
| Enterprise | Custom | Custom |
When you hit a limit you'll get a 429 with a Retry-After header.
Next
Read the detail docs for each endpoint: