Guides
- User Guide9,560 words, about 42 min to read. Markdown
- Admin Guide11,733 words, about 51 min to read. Markdown
ggml-org/llama.cpp
llama.cpp is a high-performance C/C++ inference engine for running Large Language Models (LLMs) locally on consumer hardware.
Generated May 2026 from ggml-org/llama.cpp at a279d0f
AI-generated documentation. The library is checked by sampling (three repositories so far); this guide was not individually reviewed. Verify against the project before relying on it.
Source and caveats
Built from the public repository github.com/ggml-org/llama.cpp at commit a279d0f. Upstream may have moved on since.
Unofficial; not affiliated with or reviewed by the project. How the guides were made, and how they were checked: guide library.