GGUF

.gguf File Types

Definition

GPT-Generated Unified Format: a file format for storing quantized large language model weights, used by llama.cpp and other local LLM inference tools.