github ggml-org/llama.cpp b8711
on GitHub

latest releases: b8713, b8712
2 hours ago
Details

gemma : perform per-layer projections in the first layer (#21612)

  • gemma : reduce graph splits by keeping per-layer ops in the input layer

  • gemma : put the per-layer proj in the first layer

  • cont : move the projection before the layer loop

macOS/iOS:

Linux:

Windows:

openEuler:

Check out latest releases or
releases around ggml-org/llama.cpp b8711

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.

Get notifications