LLM VRAM Calculator
How much GPU memory do you need to run or fine-tune a model? Pick the size, precision, and what you're doing — get a VRAM estimate and a GPU that fits. Everything runs in your browser.
Estimate only — actual usage varies with batch size, sequence length, framework, and kernels. For models that use grouped-query or multi-query attention (most 70B+ open models), the KV-cache figure here is a deliberate over-estimate, so real inference memory is often lower.
Related guides
- LoRA & QLoRA fine-tuning guide — how the modes above actually differ
- LLM inference engines compared — once it fits, serve it efficiently
- Self-hosting LLMs vs cloud APIs — is buying the GPU worth it?
Related reading
Fine-Tune LLMs with LoRA and QLoRA: 2026 Guide
Learn to fine-tune LLMs with LoRA and QLoRA in 2026. VRAM requirements, dataset prep, Unsloth/Axolotl setup, hyperparameters, and evaluation.
Read →Unsloth on One GPU: Llama 3.1 8B Throughput, VRAM, and Quality
We compared Unsloth with a standard Hugging Face TRL QLoRA pipeline on one RTX 4090: training time, VRAM, quality, dependency failures, and limits.
Read →Groq API in Production: Latency, Throughput, and Cost Trade-Offs
GroqCloud for latency-sensitive agents: a streaming benchmark harness, July 2026 pricing snapshots, rate-limit and tier limits, and an SSE failure test.
Read →Find these tools useful?
Get one short weekly dispatch with new tools, guides, and what we tested. No spam, unsubscribe anytime.