Quant picker

One-sentence answer: Compare quant file sizes plus KV/overhead against GPU VRAM.

Educational calculator. Formulas are plain text. Replace defaults with your documents when accuracy matters.

VRAM GB

Q4 GB

Q5 GB

Q8 GB

KV+oh GB

How it is calculated

Fits if size+kv ≤ VRAM; TIGHT if headroom < 10% of VRAM.

Worked example

12GB with Q4 4.9 + 1.5 KV fits; Q8 8.5 + 1.5 may fail.

Limits

Not a substitute for official quotes, tax software, or licensed advice.
Local rules and product terms can differ from this simplified model.
Static page: inputs are not stored on a server.

Embed:

<iframe src="https://vramwise.com/tools/quant-picker/?embed=1" title="Quant picker" loading="lazy" style="width:100%;min-height:420px;border:0"></iframe>
<p><a href="https://vramwise.com/tools/quant-picker/">Quant picker by VRAMwise</a></p>

Fit checker

All tools · Guides · Methodology

Disclaimer

Educational use only. Not tax, legal, investment, or purchasing advice.

Field guides

context budgeting · cpu offload speed · how we calc vram · kv cache math

Catalog exits

Tools · Guides · Data

Frequently asked questions

What is this for?

See which Q4/Q5/Q8 class sizes fit a VRAM budget with KV overhead. Use the formulas and examples; change one input at a time.

Is this advice?

No. Educational estimates only. Confirm with primary sources and professionals.

How fresh are defaults?

Defaults cite as-of dates on data pages or tool notes.

Can I embed it?

Yes — keep the attribution link on the parent page.

Any AdSense code?

No ad script loader or shared pub-id is embedded here.

Result looks wrong?

Check units and model limits, then contact with URL and inputs.