Glossary · Technology

GGUF Format

A file format for storing quantized language model weights, widely used by local-inference tools like llama.cpp to run models efficiently on consumer hardware.