Cerebras · Wafer-Scale Engine · Layer 2
Cerebras WSE-3
Latency-critical inference. Delivered Llama 4 Maverick at 2,500 tokens per second per user — a figure no GPU cluster approaches.
rent Rentable by the hour from multiple clouds; purchasable at scale.
Specifications
- Memory
- 44 GB on-chip SRAM
- Bandwidth
- 21 PB/s on-chip
- Compute
- 900,000 AI cores, 4 trillion transistors
- Power
- Not published per unit
- Interconnect
- On-wafer fabric
- Software
- Cerebras SDK, PyTorch
- Form factor
- wafer
- Workload
- inference
Verified 2026-09-06. Fields reading “not published” are exactly that — we do not estimate a figure a vendor withholds.
The catch
44 GB of SRAM is the whole memory system. There is no HBM to fall back on, so the model has to fit the architecture. This is a specialist part, not a general one.
The economics
Roughly 3-8x Groq's raw throughput depending on the benchmark, but Groq is cheaper per million tokens. Speed and cost point at different chips here.
Cost per million tokens is the metric that decides most real purchases, and there is no neutral benchmark for it — every published figure comes from a company selling one side of the comparison. Read all of them, ours included, as claims rather than measurements.
The power question underneath this
A rack of frontier accelerators draws 120–200 kW against a 2026 average of about 27 kW, and the US grid interconnection queue exceeds 2,600 GW with waits approaching five years. Whether you can energise this part is now a harder question than whether you can buy it.
Layer 1 — Energy · The interconnection queue · Rack power density · Tokens per watt
Compared against
- Cerebras WSE-3 vs Groq LPU — Speed against cost. Cerebras is 3-8x faster; Groq is cheaper per million tokens.Compare with Groq LPU
Related silicon
- Groq LPU — 230 MB SRAM per chip, no HBM, rent
- SambaNova SN40L — 520 MiB SRAM + 64 GiB HBM + up to 1.5 TiB DDR per socket, rent
- AMD Instinct MI300X — 192 GB HBM3, rent
- AMD Instinct MI350X — 288 GB HBM3E, rent
- AMD Instinct MI355X — 288 GB HBM3E, rent
- AWS Inferentia 2 — Not published in directly comparable terms, cloud only