withcatai/node-llama-cpp v3.18.1

on GitHub

3.18.1 (2026-03-17)

Features

• customize postinstall behavior (#582) (57bea3d) (documentation: Customizing postinstall Behavior)
• experimental support for context KV cache type configurations (#582) (57bea3d) (documentation: LlamaContextOptions["experimentalKvCacheKeyType"])
• support NVFP4 quants (#582) (57bea3d)

Shipped with llama.cpp release b8390

To use the latest llama.cpp release available, run npx -n node-llama-cpp source download --release latest. (learn more)