AI is only
as fast as
its memory.
One token from a 70B model at 4-bit reads 35 GB of weights. Bandwidth, not arithmetic, sets the speed.
From laptop to data center
- Thin-and-light laptopLPDDR5X-7500, 128-bit120 GB/s
- Apple M4 ProLPDDR5X unified273 GB/s
- Apple M4 MaxLPDDR5X unified546 GB/s
- GeForce RTX 4090GDDR6X, 384-bit1,008 GB/s
- GeForce RTX 5090GDDR7, 512-bit1,792 GB/s
- NVIDIA H100 SXMHBM3, 5 stacks3,350 GB/s
- NVIDIA H200HBM3E, 6 stacks4,800 GB/s
- AMD Instinct MI300XHBM3, 8 stacks5,300 GB/s
- NVIDIA B200HBM3E, 8 stacks8 TB/s
Inside an HBM package
| Generation | Interface | Pin speed | Per stack | Stack height | Capacity |
|---|---|---|---|---|---|
| HBM2E | 1024-bit | 3.6 Gb/s | 460 GB/s | 4–8 high | up to 16 GB |
| HBM3 | 1024-bit | 6.4 Gb/s | 819 GB/s | 8–12 high | up to 24 GB |
| HBM3E | 1024-bit | 9.2–9.8 Gb/s | ≈1.2 TB/s | 8–12 high | 24–36 GB |
| HBM4 | 2048-bit | 8 Gb/s (JEDEC) | 2 TB/s | up to 16 high | up to 64 GB |
The supply chain, by role
Supported RWA active Robinhood Stock Token. Industry company listed for its role.
AI memory
Make the DRAM dies and stack them into HBM.
- SK hynixSupported RWA
Largest HBM supplier. First to mass-produce 12-high HBM3E.
- Products
- HBM3E 12-high, HBM4
- Listing
- KRX 000660 · US ADS
- Price
- —
- Stock Token
- SKHY on Robinhood Chain
- MicronSupported RWA
US memory maker. 12-high 36 GB HBM3E, GDDR7 for graphics.
- Products
- HBM3E 12-high, GDDR7, LPDDR5X
- Listing
- NASDAQ MU
- Price
- —
- Stock Token
- MU on Robinhood Chain
- Samsung ElectronicsIndustry company
One of the three major DRAM makers. HBM3E and HBM4.
- Products
- HBM3E, HBM4, LPDDR5X, GDDR7
- Listing
- KRX 005930
Packaging
Put HBM stacks beside the compute die on one silicon interposer.
- TSMCSupported RWA
Builds most AI accelerators. CoWoS places HBM beside the compute die.
- Products
- CoWoS-S / -L, N4 / N3 logic
- Listing
- NYSE TSM (ADR) · TWSE 2330
- Price
- —
- Stock Token
- TSM on Robinhood Chain
Accelerators
Design the processors that HBM feeds.
- NVIDIASupported RWA
H200: 141 GB HBM3E at 4.8 TB/s. B200: 8 TB/s.
- Products
- H200, B200, B300
- Listing
- NASDAQ NVDA
- Price
- —
- Stock Token
- NVDA on Robinhood Chain
- AMDSupported RWA
MI300X: 192 GB HBM3 at 5.3 TB/s. MI355X: 288 GB at 8 TB/s.
- Products
- Instinct MI300X, MI325X, MI355X
- Listing
- NASDAQ AMD
- Price
- —
- Stock Token
- AMD on Robinhood Chain
Checked against Robinhood's token registry, live 2026-09-27. Stock Tokens are issued by Robinhood Assets (Jersey) Limited and are not offered to U.S. persons.
What your number means
The fastest a model can decode on your memory. Measure your machine
Educational only. Not investment advice or an offer of any security or token. Product figures are vendor specifications.