Prefill and token generation speed
Qwen3.8 27B on Mac mini M4 32GB: response speed
Explore Qwen3.8 27B response speed on a Mac mini M4 32GB. Beyond fitting the model, see whether the wait for a question and a longer response suits you.
Benchmark-based estimate · 4K input · one user
Last updated
Change device or model
Expand settings Settings4-bit · 4K · Baseline decodeCollapse
Reading this result
Fitting a 27B model and answering quickly are different questions. If streaming feels slow after input processing, compare with the different chip in an M4 Pro rather than looking at memory capacity alone.
- Required / available memory
- 17.6GB / 27GB
- Runtime
- MLX 4-bit
Compare this model side by side
Play the same model alongside an M4 Pro 48GB. Include prefill for frequent document input, or start with generation speed for short conversational turns.
Check configuration
Mac mini M4 32GB · Memory 32GB
Qwen3.8 27B Q4_K_M configuration. Check that the retailer lists the same memory option.
What changes with a longer document?Expand input length, waiting time, speed and memory
Detailed analysis and all 61 hardware configurations
Popular configurations
Speed simulations by device and model
Qwen3.8 27B: is a Mac mini M4 Pro 48GB worth it?
12.3 ~ 13.7 tok/s · 7.8 ~ 14.3 s
Qwen3.8 27B on MacBook Pro M5 Pro 64GB
14.7 ~ 17.1 tok/s · 8.6 to 10.0 seconds
Qwen3.8 27B on Mac Studio M4 Max 128GB
27.9 ~ 60.4 tok/s · 5.8 to 10.5 seconds
Qwen3.8 27B on RTX 3090: do you need an upgrade?
42.3 ~ 46.9 tok/s · 4.4 to 7.5 seconds