Aman Gupta 8bece2eb20 CUDA: use mmvq for mul-mat-id for small batch sizes (#18958) ...

* CUDA: use mmvq for mul-mat-id for small batch sizes

* add mmvq too

* Fix perf issue on ampere. Use mmvf mm-id only for non-nvidia GPUs

* templatize multi_token_path

2026-02-03 23:31:23 +08:00

..

cmake

ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (#15094)

2025-08-07 13:45:41 +02:00

include

ggml-cpu: FA split across kv for faster TG (#19209)

2026-02-03 01:19:55 +08:00

src

CUDA: use mmvq for mul-mat-id for small batch sizes (#18958)

2026-02-03 23:31:23 +08:00

.gitignore

vulkan : cmake integration (#8119)

2024-07-13 18:12:39 +02:00

CMakeLists.txt

Bump cmake max version (needed for Windows on Snapdragon builds) (#19188)

2026-02-01 14:13:38 -08:00