GPUs / Apple
Apple M3 Max
- Memory
- LPDDR5
- Bus
- 512-bit
- Published peak
- 400 GB/s
- Capacity
- from 36 GB
Measured
- Read
- 275.5GB/s
- Write
- 220.0GB/s
- Copy
- 240.1GB/s
- Random
- 52.5GB/s
- Latency
- 394ns
- Sustain
- 240.9GB/s
Medians of 1 verified run from 1 operator.
Local AI speed
| Model | Parameters | 4-bit, tokens/s | 8-bit, tokens/s |
|---|---|---|---|
| Llama 3.1 8B | 8.03B | ≤ 69 | ≤ 34 |
| Qwen 2.5 14B | 14.7B | ≤ 37 | ≤ 19 |
| gpt-oss-20b | 21B, 3.6B active | ≤ 153 | ≤ 77 |
| Mistral Small 24B | 24B | ≤ 23 | ≤ 11 |
| Qwen 2.5 32B | 32.5B | ≤ 17 | ≤ 8.5 |
| Llama 3.3 70B | 70.6B | ≤ 7.8 | Does not fit |
| gpt-oss-120b | 117B, 5.1B active | Does not fit | Does not fit |