github ggml-org/llama.cpp b7832
on GitHub

latest releases: b9733, b9732, b9731...
4 months ago
Details

kv-cache : support V-less cache (#19067)

  • kv-cache : support V-less cache

  • cuda : better check for V_is_K_view

  • cuda : improve V_is_K_view check

  • graph : add comments

  • hparams : refactor

macOS/iOS:

Linux:

Windows:

openEuler:

Check out latest releases or
releases around ggml-org/llama.cpp b7832

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.

Get notifications