日本語のみで絞り込む
The main goal of llama.cpp is to enable LLM (and VLM) inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in ...
- Releaseshttps://github.com/ggml-org/llama.cpp/attestations/65072510 ...
- Build llama.cpp locallyThe project also includes many example programs and tools ...
- README.mdThe main goal of llama.cpp is to enable LLM (and VLM ...
- Codellama.cpp server-vulkan-b12199 Public Latest. LLM inference in ...
- Llama.cpp server option ...It runs as a self-bootstrapping middleware layer that ...
- Ggml-org/llama.cppThe main goal of llama.cpp is to enable LLM (and VLM ...
Static builds of llama.cpp (Currently AMD64 only). Contribute to EZForever/llama.cpp-static development by creating an account on GitHub.
llama.cpp is an open-source software library that performs inference on various large language models such as Meta's Llama model.
Llama.cpp (LLaMA C++) allows you to run efficient Large Language Model Inference in pure C/C++. Download llama.cpp for Windows, Linux and Mac.
Getting started with llama.cpp is straightforward. Here are several ways to install it on your machine: Install llama.cpp using brew, nix, winget, ...
2025/9/21 -You can attach files as context to your query in the llama.cpp server. Is there any way/plugin/etc. to attach an entire git repo for context, ...
OpenAI Compatible Web Server. llama-cpp-python offers a web server which aims to act as a drop-in replacement for the OpenAI API. This allows you to use llama.