github ggml-org/llama.cpp b8606
on GitHub

5 hours ago
Details

ggml-webgpu: port all AOT operators to JIT (#20728)

  • port cpy pipeline to shader lib with JIT compilation
  • port glu pipeline to shader lib with JIT compilation
  • port rope pipeline to shader lib with JIT compilation
  • port soft_max pipeline to shader lib with JIT compilation
  • removed unused functions from embed_wgsl.py which were used for
    old AOT template expansion

macOS/iOS:

Linux:

Windows:

openEuler:

Check out latest releases or
releases around ggml-org/llama.cpp b8606

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.

Get notifications