約107件1ページ目

日本語のみで絞り込む

llama.cpp is measuring very well compared to the baseline implementations. Quantization has a small negative impact to quality, but, as you can see, running 13B ...

llama.cpp is an open-source software library that performs inference on various large language models such as Meta's Llama model.

Llama.cpp is a inference engine written in C/C++ that allows you to run large language models (LLMs) directly on your own hardware compute. It was ...

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud ...

Simple Python bindings for @ggerganov's llama.cpp library. This package provides: Low-level access to C API via ctypes interface. High-level Python API for ...

Scripts for monitoring llama.cpp development. README-compile-times.md - Compile time measurements; README-todo-counts.md - TODO/FIXME ...