Prefill and token generation speed

Qwen3.8 27B: is a Mac mini M4 Pro 48GB worth it?

Check the speed that matters when buying an M4 Pro 48GB for Qwen3.8 27B. Compare prefill and generation separately to decide whether your work benefits from moving beyond an M4 32GB.

Benchmark-based estimate · 4K input · one user

Last updated

12.3 ~ 13.7 tok/sDecode speed
Model fully loaded (17.56GB / 41GB)
First token (TTFT)
7.8 ~ 14.3 sContext 4,096 input tokens included
Prefill speed
289 ~ 530 tok/s7.7 to 14.2 seconds (Benchmark-calibrated)
Total time (E2E)
Approximately 16.3 to 23.7 seconds117 output tokens included
Press Play to process the input and generate the answer.
Ready
Change device or model
273 GB/s
27B
Expand settings 4-bit · 4K · Baseline decode
QuantizationNeed 17.56GB
Input context4K tokens
Baseline
Baseline
Sample question:
117 output tokens

Reading this result

Long code or document inputs repeatedly incur a wait before the first sentence. Looking only at tok/s after generation starts misses that part. Recheck with an input length close to your usual work.

Required / available memory
17.6GB / 41GB
Runtime
MLX 4-bit

Compare this model side by side

If the M4 32GB already feels fast enough, the case for an upgrade weakens. Check the difference in completion time before comparing prices.

Check configuration

Mac mini M4 Pro 48GB · Memory 48GB

Qwen3.8 27B Q4_K_M configuration. Check that the retailer lists the same memory option.

What changes with a longer document?Expand input length, waiting time, speed and memory
Detailed analysis and all 61 hardware configurations

Popular configurations

View all 20