What is GGUF?

GGUF is the file format used by llama.cpp to store quantised model weights together with their metadata and tokeniser in a single file.

Primary sources

Specifications cited by the tools below whose own titles define GGUF.

llama.cpp — GGUF specificationggml

2 tools that work with GGUF

Files never leave your browser.

AI & LLM Tools2

GGUF Quantisation Size CalculatorWork out the download size of a quantised model at every GGUF level, and what quality each one costs you.LLM VRAM CalculatorWork out exactly how much video memory a local model needs, including the KV cache that scales with context length.

Related terms

Terms that appear alongside GGUF on the same tools.

← All glossary terms Browse every tool →