9時間前 -LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
3日前 -The main goal of llama.cpp is to enable LLM (and VLM) inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in ...
6日前 -LLaMA.cpp HTTP Server Fast, lightweight, pure C/C++ HTTP server based on [httplib](https://github.com/yhirose/cpp-httplib), ...
1日前 -A community fork of llama.cpp for AMD Strix Halo - the Ryzen AI Max / Max+ 300 series APUs ( gfx1151 , RDNA 3.5 integrated GPU, up to 128 GB of unified LPDDR5X ...
4日前 -llama.cpp is an open-source software library that performs inference on various large language models such as Meta's Llama model.
2026/6/29 -Run an LLM locally with llama.cpp in 12 steps (~40 min): build it, grab a GGUF model, serve an OpenAI-compatible API. 118000+ GitHub stars.
2026/8/17 -llama.cpp version v0.1.0 has been released ... llama.cpp is apparently moving to semantic versioning instead of just sequential build numbers (like b10456).
2026/9/22 -We're adding support for running GGUF models efficiently in transformers, so you can use checkpoints sized for your laptop's memory through the familiar ...
2026/10/9 -llama.cpp is a lightweight C/C++ inference stack for large language models. You build it with CUDA so it fully utilizes the GPU on your hardware platform, ...