Prefill and token generation speed

Mac mini M4 Pro 64GB with Qwen3.6 35B-A3B (MoE): prefill and generation speed

Last updated

273 GB/s
Active 3B / Total 35B
19.6 ~ 46.1 tok/sDecode speed
Model fully loaded (21.28GB / 56GB)
First token (TTFT)
2.7 ~ 6.3 sContext 4,096 input tokens included
Prefill speed
658 ~ 1,547 tok/s2.6 to 6.2 seconds (Benchmark-calibrated)
Total time (E2E)
Approximately 5.2 to 12.2 seconds117 output tokens included
Press Play to process the input and generate the answer.
Ready
Expand settings 4-bit · 4K · Baseline decode
QuantizationNeed 21.28GB
Input context4K tokens
Baseline
Baseline
Sample question:
117 output tokens

Check configuration

Mac mini M4 Pro 64GB · Memory 64GB

Qwen3.6 35B-A3B (MoE) Q4_K_M configuration. Check that the retailer lists the same memory option.

Already own it? Open the setup guide

Would another device feel faster?

Compare the same model including prefill, or just token generation.

What changes with a longer document?Expand input length, waiting time, speed and memory
Detailed analysis and all 60 hardware configurations

Popular configurations

View all 20