Intel · Gaudi · Layer 2
Intel Gaudi 3
Buyers who want standard Ethernet networking instead of proprietary interconnect, and a genuinely lower acquisition price.
buy You can purchase this outright.
Specifications
- Memory
- 128 GB HBM2E
- Bandwidth
- 3.7 TB/s
- Compute
- Gaudi-generation BF16/FP8
- Power
- 600 W
- Interconnect
- Integrated RoCE over Ethernet
- Software
- SynapseAI, PyTorch
- Form factor
- accelerator
- Workload
- both
Verified 2026-09-06. Fields reading “not published” are exactly that — we do not estimate a figure a vendor withholds.
The catch
The smallest software ecosystem of the major options. Intel's roadmap for this line has also been the least predictable, which is a procurement risk independent of the silicon.
The economics
Priced to undercut. The saving is real; the engineering time to make your stack work on it is the cost nobody quotes.
Cost per million tokens is the metric that decides most real purchases, and there is no neutral benchmark for it — every published figure comes from a company selling one side of the comparison. Read all of them, ours included, as claims rather than measurements.
The power question underneath this
A rack of frontier accelerators draws 120–200 kW against a 2026 average of about 27 kW, and the US grid interconnection queue exceeds 2,600 GW with waits approaching five years. Whether you can energise this part is now a harder question than whether you can buy it.
Layer 1 — Energy · The interconnection queue · Rack power density · Tokens per watt
Compared against
- Intel Gaudi 3 vs NVIDIA H100 — Standard Ethernet and a lower price against the deepest software ecosystem in computing.Compare with NVIDIA H100
Related silicon
- NVIDIA RTX PRO 6000 Blackwell — 96 GB GDDR7, buy
- Tenstorrent Blackhole — GDDR6 rather than HBM, buy
- AMD Instinct MI300X — 192 GB HBM3, rent
- AMD Instinct MI350X — 288 GB HBM3E, rent
- AMD Instinct MI355X — 288 GB HBM3E, rent
- AWS Trainium 2 — Not published in directly comparable terms, cloud only