mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2026-02-05 13:53:23 +02:00
7cc2d2c889
Some checks failed
flake8 Lint / Lint (push) Has been cancelled
Python Type-Check / pyright type-check (push) Has been cancelled
* ggml : move AMX to the CPU backend --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
llama.cpp/example/run
The purpose of this example is to demonstrate a minimal usage of llama.cpp for running models.
./llama-run Meta-Llama-3.1-8B-Instruct.gguf
...