github ggml-org/llama.cpp b11721

pre-releaseone hour ago
Details

cuda : fuse qwen4exp's SCALE -> SIGMOID -> SCALE -> hc_post chain (#30602)

Port of the Vulkan HC_POST_GATE fusion (#29520). hc_combine builds the
hc_post weights as 2sigmoid(inject/hc); dsv4_hc_post_f32 now takes a
gated template flag and computes scale_out
sigmoid(scale_in*p) from the
raw weights, so the chain runs as one kernel instead of four.

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.