9時間前 -LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
11時間前 -Prebuilt binaries of llama.cpp libraries and executables for Linux with CUDA or Vulkan, Linux arm64 with CPU, Vulkan, or OpenCL, and WebAssembly.
21時間前 -LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
21時間前 -The main goal of llama.cpp is to enable LLM (and VLM) inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in ...
15時間前 -LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
17時間前 -It supports NInfer, llama.cpp, PolyStrata and Radiance through a local Web UI and OpenAI-compatible APIs. See the Radiance integration guide for its AMD ...
20時間前 -Avalon (https://github.com/freriadoc/Avalon) is freriadoc's llama.cpp fork for Qwen3.8-Flash-Next. It keeps the model's experts in system RAM and the rest on ...
12時間前 -It simply wraps llama-server.exe in a modern WinUI interface and supports minimizing to the system tray. This prevents your taskbar from being cluttered with ...
15時間前 -Avalon is a fork of llama.cpp built for one model, Qwen3.8-Flash-Next (512 experts, 10 active, 48 layers), on one consumer GPU with the experts in system RAM.
14時間前 -llama.cpp answers noul , choice and score questions over a state (text or JSON), pictures, a video, audio clips ...