約123件1ページ目

日本語のみで絞り込む

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud ...

Llama.cpp is a inference engine written in C/C++ that allows you to run large language models (LLMs) directly on your own hardware compute. It was ...

llama.cpp is an open-source software library that performs inference on various large language models such as Meta's Llama model.

Simple Python bindings for @ggerganov's llama.cpp library. This package provides: Low-level access to C API via ctypes interface. High-level Python API for ...

llama.cpp is measuring very well compared to the baseline implementations. Quantization has a small negative impact to quality, but, as you can see, running 13B ...

The main goal of llama.cpp is to enable LLM (and VLM) inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in ...