GPUs / NVIDIA

RTX 4050 Laptop

Memory
GDDR6
Bus
96-bit
Published peak
192 GB/s
Capacity
from 6 GB

Measured

Read
173.1GB/s
Write
169.3GB/s
Copy
160.8GB/s
Random
28.5GB/s
Latency
254ns
Sustain
159.6GB/s

Medians of 1 verified run from 1 operator.

Local AI speed

ModelParameters4-bit, tokens/s8-bit, tokens/s
Llama 3.1 8B8.03B≤ 43Does not fit
Qwen 2.5 14B14.7BDoes not fitDoes not fit
gpt-oss-20b21B, 3.6B activeDoes not fitDoes not fit
Mistral Small 24B24BDoes not fitDoes not fit
Qwen 2.5 32B32.5BDoes not fitDoes not fit
Llama 3.3 70B70.6BDoes not fitDoes not fit
gpt-oss-120b117B, 5.1B activeDoes not fitDoes not fit
Upper bounds: median read ÷ bytes read per token. Mixture-of-experts models read only their active experts. Fit checks weights against the smallest 6 GB configuration; the KV cache needs room on top.

Top operators

#OperatorScoreReadDate
1OP-8D05A561.2173.1 GB/s2026-09-27

Full RTX 4050 Laptop leaderboard