What is Quantization?

Quantisation stores a model’s weights at lower numeric precision — 8-bit or 4-bit instead of 16-bit floats — cutting memory use substantially at some cost in accuracy.

2 tools that work with Quantization

Files never leave your browser.

AI & LLM Tools2

GGUF Quantisation Size CalculatorWork out the download size of a quantised model at every GGUF level, and what quality each one costs you.LLM VRAM CalculatorWork out exactly how much video memory a local model needs, including the KV cache that scales with context length.

Related terms

Terms that appear alongside Quantization on the same tools.

← All glossary terms Browse every tool →