約4,770件1ページ目

日本語のみで絞り込む

条件を指定して検索しています。すべての条件を解除する

  • 最終更新日:1か月以内
  • 3日前 -llama.cpp supports a number of hardware acceleration backends to speed up inference as well as backend specific options. See the llama.cpp README for a full ...

    2026/10/23 -Install llama-cpp-python with uv or pip using CPU, CUDA, or Metal wheels, with source fallbacks and uv project configuration.

    2026/11/2 -Linux NVIDIA is supported, with experimental AMD Linux and Windows support. ... How to enable CUDA-support for llama-cpp-python? r/LocalLLaMA. • 2y ago. How to ...

    4日前 -Fast, lightweight, pure C/C++ HTTP server based on httplib, nlohmann::json and llama.cpp. Set of LLM REST APIs and a web UI to interact with llama.cpp.

    Might give this a try today, been playing with llama.cpp and basalt as of lately, always good to try new engines ... It is completely hardware agnostic and python ...

    LinkedInSteeve Morin

    2026/10/29 -`-ngl 99` puts every layer on the GPU . On CPU only, leave it out. Any llama.cpp backend works (CPU, CUDA, Vulkan…); the `dale` CLI uses Vulkan.

    5日前 -The biggest upgrade is not a new model or a magical performance boost. It is a stable contract for the growing ecosystem built on top of llama.cpp.

    21時間前 -Build a repeatable NVIDIA GPU benchmark workflow for Windows 11 or Linux using graphics tests, llama-bench, and telemetry while changing one variable at a ...

    2026/10/20 -It wraps llama.cpp, the most optimized CPU/GPU inference engine for quantized models, in a simple CLI and REST API. You download a model with one command, ...

    2026/10/27 -Check whether llama.cpp is actually using CUDA. Docker can see the GPU while llama.cpp still runs on CPU because the serve engine was built without CUDA: Unable ...