Side-by-side simulation · recommended settings
RTX 4090 vs RTX 5090 local LLM speed/VRAM comparison
If it's a 24GB model, the 4090 or mid-range might be reasonable, and if you need a 32GB loading limit, it's narrowed down to the 5090.
Choose devices and a model
Expand comparison settings
Same 117output tokens. Only evidence-qualified acceleration is selected automatically; runtime formats are shown on each device.
Left
ReadyRTX 4090 24GB
Press Start above to generate the same answer on both devices.
Right
ReadyRTX 5090 32GB
Press Start above to generate the same answer on both devices.
With these settings, RTX 5090 32GB finishes the full answer About 1.5× faster.
Compare from input processing to completion of 117 token response.
Which one fits my needs?
Answer completion
RTX 5090 32GB
At the estimate midpoint, it finishes the same answer about 1.5× faster.
Prompt processing
RTX 5090 32GB
The estimated input-processing midpoint is higher at 6,710 tok/s.
Image and video generation
Check the media model
LLM speed does not tell you media-generation performance. Choose the image or video model and resolution separately.
Runtime
Settings for your hardware
Strata 0.1.33 serving branch · IQ3_S · MTP-4 · INT8 KV · SSD PLE / Strata 0.1.41 · IQ3_S · MTP-6 · INT8 KV · SSD PLE. When runtime paths differ, the speed gap also includes software and model-format differences.
Estimated power draw
RTX 4090 24GB
Estimated LLM power draw is lower at about 470 W. Noise and physical size need a separate check.
Local pricing
RTX 5090 32GB costs about 551 × KRW 10,000 more at the reference-price midpoint, with an estimated answer time about 33% shorter.
Before choosing hardware
| Measure | RTX 4090 24GB | RTX 5090 32GB |
|---|---|---|
| Available fast memory | 22.5GB | 30.5GB |
| Memory bandwidth | 1008GB/s | 1792GB/s |
| Estimated total time | 1.8 s | 1.2 s |
| Estimated sustained LLM load | about 470W | about 620W |
| Korean price range (KRW) | 325–400 × KRW 10,000 | 899–929 × KRW 10,000 |
Estimated ranges for one user. Multi-GPU and multi-device results depend on the runtime and interconnect.