Command R 35B
Built for grounded citation. On canary until it holds p99 under 90 ms for a fortnight.
29ms
p50 from the nearest warm region
288tok/s
Single stream, no batching
128K
Full window, no sliding truncation
$0.19
Per million tokens served
Tuned for retrieval-augmented generation and grounded citation. Currently on canary — five per cent of traffic, and it will go live once it has held p99 under 90 ms for a fortnight.
Deploymentdep_c74d97
Parameters35B
Quantisationfp8
LicenceCC-BY-NC
Home regionyyz1
Extra replicas3
p50 latency31ms
p99 latency76ms
Requests / s1940
Figures are illustrative — this is a demonstration site.
Last 30 minutesyyz1
cache hitqueue 0ms
errors 0