llama-cpplisted

Guide for llama.cpp, the C/C++ LLM inference framework by ggml-org. Covers the C API (llama.h), GGUF format, quantization (Q4_K_M, Q8_0, IQ4_XS), CMake builds, GPU backends (CUDA, Vulkan, Metal, ROCm), HTTP server with OpenAI-compatible API, embeddings, grammar constraints, function calling, LoRA, speculative decoding, multimodal, and UE5 integration. Use when: llama.cpp, GGUF models, local LLM inference, llama.h, llama-server, quantizing, ggml, building/linking llama.cpp, GPU acceleration, llama.cpp embeddings, grammar/JSON output, llama.cpp in Unreal Engine, llama_* API functions, GGUF format, converting HuggingFace to GGUF, or comparing with vLLM/Ollama/TensorRT-LLM.
maystudios/claude-skills · ★ 21 · AI & Automation · score 79

Install: claude install-skill maystudios/claude-skills

# llama.cpp -- C/C++ LLM Inference Framework Guide ## Official Documentation | Source | URL | |--------|-----| | **GitHub Repository** | https://github.com/ggml-org/llama.cpp | | **C API Header (llama.h)** | https://github.com/ggml-org/llama.cpp/blob/master/include/llama.h | | **C++ RAII Wrappers** | https://github.com/ggml-org/llama.cpp/blob/master/include/llama-cpp.h | | **Build Instructions** | https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md | | **Server Documentation** | https://github.com/ggml-org/llama.cpp/blob/master/tools/server/README.md | | **Quantization Tool** | https://github.com/ggml-org/llama.cpp/blob/master/tools/quantize/README.md | | **GGUF Specification** | https://github.com/ggml-org/ggml/blob/master/docs/gguf.md | | **Function Calling Docs** | https://github.com/ggml-org/llama.cpp/blob/master/docs/function-calling.md | | **Multimodal Docs** | https://github.com/ggml-org/llama.cpp/blob/master/docs/multimodal.md | | **Examples Directory** | https://github.com/ggml-org/llama.cpp/tree/master/examples | | **HuggingFace GGUF Hub** | https://huggingface.co/docs/hub/gguf-llamacpp | | **Llama-Unreal Plugin** | https://github.com/getnamo/Llama-Unreal | ## What is llama.cpp? llama.cpp is a pure C/C++ LLM inference engine with minimal dependencies, designed for high-performance local inference across CPUs and GPUs. Key properties: - **MIT licensed**, extremely active development (~daily releases, currently b8766+) - **Widest hardware support**: N