github withcatai/node-llama-cpp v3.12.3

latest releases: v3.16.2, v3.16.1, v3.16.0...
6 months ago

gpt-oss is here!

Read about the release in the blog post


3.12.3 (2025-08-26)

Bug Fixes

  • Vulkan: context creation edge cases (#492) (12749c0)
  • prebuilt binaries CUDA 13 support (#494) (b10999d)
  • don't share loaded shared libraries between backends (#492) (12749c0)
  • split prebuilt CUDA binaries into 2 npm modules (#495) (6e59160)

Shipped with llama.cpp release b6294

To use the latest llama.cpp release available, run npx -n node-llama-cpp source download --release latest. (learn more)

Don't miss a new node-llama-cpp release

NewReleases is sending notifications on new releases.