GPUs / NVIDIA
RTX 5090
- Memory
- GDDR7
- Bus
- 512-bit
- Published peak
- 1,792 GB/s
- Capacity
- 32 GB
Measured
- Read
- 1722GB/s
- Write
- 1479GB/s
- Copy
- 1394GB/s
- Random
- 188.9GB/s
- Latency
- 289ns
- Sustain
- 1373GB/s
Medians of 34 verified runs from 13 operators. Read reaches 96 % of the published peak.
Local AI speed
| Model | Parameters | 4-bit, tokens/s | 8-bit, tokens/s |
|---|---|---|---|
| Llama 3.1 8B | 8.03B | ≤ 429 | ≤ 214 |
| Qwen 2.5 14B | 14.7B | ≤ 234 | ≤ 117 |
| gpt-oss-20b | 21B, 3.6B active | ≤ 957 | ≤ 478 |
| Mistral Small 24B | 24B | ≤ 143 | ≤ 72 |
| Qwen 2.5 32B | 32.5B | ≤ 106 | Does not fit |
| Llama 3.3 70B | 70.6B | Does not fit | Does not fit |
| gpt-oss-120b | 117B, 5.1B active | Does not fit | Does not fit |
Top operators
| # | Operator | Score | Read | Date |
|---|---|---|---|---|
| 1 | OP-AAC8AC | 105.9 | 1762 GB/s | 2026-09-27 |
| 2 | OP-0E9B41 | 105.7 | 1736 GB/s | 2026-09-27 |
| 3 | OP-B92C59 | 105.7 | 1735 GB/s | 2026-09-27 |
| 4 | OP-39B43F | 105.7 | 1750 GB/s | 2026-09-27 |
| 5 | OP-F88900 | 105.6 | 1731 GB/s | 2026-09-27 |
| 6 | OP-5AE543 | 105.6 | 1728 GB/s | 2026-09-27 |
| 7 | OP-A6B99E | 105.6 | 1722 GB/s | 2026-09-27 |
| 8 | OP-9C3CED | 105.5 | 1720 GB/s | 2026-09-27 |
| 9 | OP-13D76C | 105.5 | 1720 GB/s | 2026-09-27 |
| 10 | OP-CAA909 | 105.5 | 1720 GB/s | 2026-09-27 |