NVIDIA GeForce RTX 5080 16GB 16GB GPU memory, main unit cost separate
It has 16 GB of VRAM and 960 GB/s of memory bandwidth. Estimates use 64 GB of system RAM at 90 GB/s; actual offload speed depends on the PC configuration.
Speed and memory for the same model
Hardware core specifications
- Available memory
- 15GB
- Memory bandwidth
- 960GB/s
- Estimated sustained LLM load
- About 352W
- Korean price range (KRW)
- 231 × KRW 10,000–239 × KRW 10,000
Who it fits
- Utilizes 15GB of available memory
- CUDA-based local inference
- K2 Horizon MoVA 36B-A4B-class high-speed generation
Skip it if
Prices cover the GPU alone; electricity estimates cover the entire PC including the GPU. Add the host PC, power supply and cooling to your purchase budget.
Recommended format for each device 4K input
The model you will experience with this equipment
K2 Horizon 0.9B
Required 1.03GB · spare time
llama.cpp CUDA · Q4_K_M
Decode
1304.2 ~ 1485.3 tok/s
First token
0.14 to 0.26 seconds
K2 Horizon MoVA 36B-A4B
recommendedRequired 21.94GB · tight
llama.cpp CUDA · Q4_K_M
Decode
27.7 ~ 27.9 tok/s
First token
0.85 to 1.5 seconds
Qwen3.8-Flash-Next
Required 52.5561152GB · tight
Strata · Blackwell (CC 12.0) · CUDA · MTP · NVMe PLE · single GPU
Decode
66.6 ~ 147.0 tok/s
First token
7.4 to 16.3 seconds
Actual speed varies with runtime version, cooling, context length and quantization file.
On sales pages, look at memory before chips.
The model and speed assumptions above change if the product is not the 16GB configuration.
Frequently asked questions
- What local LLMs can I run on RTX 5080 16GB?
- K2 Horizon 0.9B, K2 Horizon MoVA 36B-A4B, Qwen3.8-Flash-Next and others with a 4K input and the recommended format. Required memory varies by model and context length.
- What is the local LLM power of RTX 5080 16GB?
- Sustained load is about 352 W, with an actual range of 232–490 W.
- Are the displayed token speeds ground truth?
- This is a range aligned to collected benchmark measurements under the same conditions. Combinations without a matching measurement are estimated from the nearest result and vary with runtime, cooling, quantization file and context length.
Equipment to compare together
similar memory
Mac mini M4 16GB
This is the right configuration to minimize costs and start with 8B to 12B models.
similar memory
Mac mini M4 24GB
If you summarize short documents and ask about small sections of code, first check whether the model you plan to use gives useful answers. If a 12B Q4 model does the job, 32GB is worth considering only when your work needs more memory headroom.
similar memory
RTX 3090 24GB
If you own an RTX 3090, first check whether the target model and context fit in 24GB. Newer hardware alone is not a reason to replace a card that completes your work. For a used purchase, include power, cooling, case compatibility and return terms in the cost.