Glossary · Infrastructure

GGUF

A file format for storing quantized language models, widely used by local inference tools like llama.cpp and Ollama to distribute models that run efficiently on consumer hardware.