日本語のみで絞り込む
The main goal of llama.cpp is to enable LLM (and VLM) inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in ...
LLaMA Server combines the power of LLaMA C++ (via PyLLaMACpp) with the beauty of Chatbot UI. LLaMA C++ (via PyLLaMACpp) ➕ Chatbot UI ➕ LLaMA ...
llama.cpp server and small language model bundled together inside a Docker image for easy deployment similar to a llamafile. Uses CPU for inference.
llama-server. A simple layer on top of ghcr.io/ggml-org/llama.cpp:server to load GGUF models from assets.maragu.dev at runtime.
llama serve can be used to serve embeddings and rerankers for retrieval workflows, and supports multimodal models (image, audio, PDFs). # Embedding server (use ...
ServLlama runs a llama-server binary cross-compiled for Android directly, so it doesn't depend on Termux! https://github.com/ArkaneFans/servllama · Screenshot1
Getting started with llama.cpp is straightforward. Here are several ways to install it on your machine: Install llama.cpp using brew, nix, winget, ...
Ollama, LM Studio and Jan have become popular choices for AI enthusiasts looking to run large language models (LLMs) locally which provide a UX-friendly ...
Fast, lightweight, pure C/C++ HTTP server based on httplib, nlohmann::json and llama.cpp. Set of LLM REST APIs and a web UI to interact with llama.cpp.