GGUF
GGUF is a file format commonly used with llama.cpp-style runtimes to ship quantized LLM weights for local CPU/GPU inference.
It packages tensors plus metadata for portable desktop and edge deployment.
GGUF is a file format commonly used with llama.cpp-style runtimes to ship quantized LLM weights for local CPU/GPU inference.
It packages tensors plus metadata for portable desktop and edge deployment.