Prefill and token generation speed

Qwen3.8 27B on MacBook Pro M5 Pro 64GB

Explore Qwen3.8 27B on a MacBook Pro M5 Pro 64GB without a separate server. Check input processing and response generation, then compare with a desktop GPU configuration.

Benchmark-based estimate · 4K input · one user

Last updated

14.7 ~ 17.1 tok/sDecode speed
Model fully loaded (17.56GB / 56GB)
First token (TTFT)
8.6 to 10.0 secondsContext 4,096 input tokens included
Prefill speed
412 ~ 479 tok/s8.6 to 9.9 seconds (Estimate from user-submitted records)
Total time (E2E)
Approximately 15.4 to 17.9 seconds117 output tokens included
Press Play to process the input and generate the answer.
Ready
Change device or model
307 GB/s
27B
Expand settings 4-bit · 4K · Baseline decode
QuantizationNeed 17.56GB
Input context4K tokens
Baseline
Baseline
Sample question:
117 output tokens

Reading this result

Portability and using one computer are also reasons to choose a laptop. A speed table cannot price those benefits for you. First decide whether this response pace works, then consider a separate machine if needed.

Required / available memory
17.6GB / 56GB
Runtime
MLX 4-bit

Compare this model side by side

An RTX 5090 is a graphics card; a MacBook is a complete computer. Compare the same model here, but include the rest of the GPU PC when evaluating purchase cost.

Check configuration

MBP M5 Pro 64GB · Memory 64GB

Qwen3.8 27B Q4_K_M configuration. Check that the retailer lists the same memory option.

What changes with a longer document?Expand input length, waiting time, speed and memory
Detailed analysis and all 61 hardware configurations

Popular configurations

View all 20