Sign in Start free
Catalogue

Every model we serve, and what it costs

Open weights only. Nothing here is a wrapper around somebody else’s hosted API — if it is in this list, it is running on our hardware in the regions you choose.

All chat code embeddings long-context reasoning
Model
Params
Context
ttft
tok/s
$ / M
LL Llama 3.3 70B Instruct fp8 · Llama 3.3 Community 70B 128K 38ms 212 $0.34 LL Llama 3.1 8B Instruct fp8 · Llama 3.1 Community 8B 128K 19ms 486 $0.06 QW Qwen2.5 72B Instruct fp8 · Qwen 72B 128K 41ms 198 $0.36 QC Qwen2.5 Coder 32B fp8 · Apache 2.0 32B 128K 27ms 318 $0.18 MS Mistral Small 3 24B fp8 · Apache 2.0 24B 32K 22ms 364 $0.14 MX Mixtral 8x7B Instruct fp8 · Apache 2.0 46.7B MoE 32K 31ms 276 $0.22 DS DeepSeek V3 fp8 · DeepSeek 671B MoE 128K 58ms 132 $0.58 DR DeepSeek R1 Distill 32B fp8 · MIT 32B 128K 34ms 244 $0.20 GM Gemma 2 27B fp8 · Gemma 27B 8K 24ms 332 $0.16 PH Phi-4 14B fp8 · MIT 14B 16K 20ms 428 $0.09 CR Command R 35B fp8 · CC-BY-NC · canary 35B 128K 29ms 288 $0.19 NE Nomic Embed Text v1.5 fp16 · Apache 2.0 137M 8K 6ms — $0.01

Put the model next to the user.

One command, thirty-one regions, and an invoice that matches what you actually served.

Deploy a model Talk to an engineer