Q4_K_M · 4K context
K2 Horizon 3.7B 3.7B dense model · estimated Q4_K_M memory about 3GB
A compact dense model that provides 512K native contexts. It's easy to start with small memories, but longer inputs require larger KV cache and prefill times, so you'll need to start with shorter baselines and increase them.
- Estimated Q4_K_M memory
- About 3GB
- total parameters
- 3.7B
- active parameter
- 3.7B
- native context
- 512K
Start with a model
Find hardware for this model
Also running document search?
Reserve this for embedding and reranking models sharing the same GPU or unified memory. Leave it at none if they run separately on the CPU.
Matching devices 44· 5 shown
Comfortable fit · Q4_K_M · Headroom 10.2GB
₩1,180,000
37.3 ~ 41.6 tok/s
Comfortable fit · Q4_K_M · Headroom 10.2GB
₩1,525,000
36.2 ~ 40.5 tok/s
Comfortable fit · Q4_K_M · Headroom 10.2GB
₩1,669,000
48.9 ~ 54.5 tok/s
Comfortable fit · Q4_K_M · Headroom 17.1GB
₩1,925,000
37.3 ~ 41.6 tok/s
Comfortable fit · Q4_K_M · Headroom 17.1GB
₩1,950,000
36.2 ~ 40.5 tok/s
Price is the range midpoint, with a basic host added for GPU-only prices. Speed is an estimate for the same model and 4K input.
If you want to choose equipment again
You can first narrow down the model configurations based on budget, noise level, operating system and whether it's acceptable used.