日本語のみで絞り込む
Building Docker locally · local/llama.cpp:full-cuda : This image includes both the llama-cli and llama-completion executables and the tools to convert LLaMA ...
llama.cpp. Repository navigation. Code · Issues740 (740) · Pull requests1.9k ... $ docker pull ghcr.io/ggml-org/llama.cpp:server-vulkan-b12199. linux/amd64.
Github action to mirror docker images between ggml-org and ggerganov. This script mirrors a set of tags from one repository to another. It is designed mirror ...
2026/5/17 -Hi All! Saw some folks waiting for the Docker images with llama.cpp and MTP when it released. Here's a quick guide to build your own image, ...
Run llama.cpp in a GPU accelerated Docker container. Minimum requirements. By default, the service requires a CUDA capable GPU with at least 8GB+ of VRAM.
The main goal of llama.cpp is to enable LLM (and VLM) inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in ...
2026/5/14 -This package version was published on May 14 . To provide a description, add the following line to your Dockerfile: LABEL org.opencontainers.
2024/12/7 -Docker containers for llama-cpp-python which is an OpenAI compatible wrapper around llama2. The motivation is to have prebuilt containers ...
Warning. Starting with version 0.1.79, the model format has changed from GGML to GGUF. Existing GGML models can be converted using the ...
2025/12/5 -The modified dockerfile can be found here llama.cpp Dockerfile for DGX Spark / GB10 · GitHub. So all steps to build a server container image ...