8時間前 -LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
5日前 -As of May 2026 , it has more than 109,000 stars on GitHub. On April 30, 2024, support for FlashAttention was added. On April 10, 2025 ...
2日前 -The main goal of llama.cpp is to enable LLM (and VLM) inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in ...
1日前 -This Python release pairs with the current prebuilt llama.cpp / GGUF runtime release: runtime-llamacpp-v0.2.6. The same verified runtime assets are attached ...
2日前 -llamAmpere is a fast version of llama.cpp (the open-source program that runs AI language models on your own computer), tuned for NVIDIA RTX 30-series ...
4日前 -Prebuilt binaries of llama.cpp with support for the ricursive architecture (ricursiveAI/Ripple-65B-Preview), which is not in upstream llama.cpp yet (PR ...
2日前 -The fonts are released under the SIL Open Font License 1.1, see fonts/OFL.txt . The Llama icon they carry at U+E000, U+E001 and U+E002 stays under the logo ...
4日前 -Install the prebuilt llama.cpp binaries. You do not need a compiler. Every llama.cpp build on GitHub ships prebuilt tarballs for Ubuntu x64 (CPU, Vulkan ...
4日前 -A patch collection that brings AMD RDNA-specific performance work to llama.cpp: MTP decode, chunked gated-delta-net prefill, BF16 KV and WMMA ...
5日前 -Jan v0.5.15: You can now tweak llama.cpp settings, and add. Jan v0.5.15 is out with exciting new features and improvements!