3.16.0 (2026-02-19)
Features
- Exclude Top Choices (XTC) (#553) (57e8c22) (documentation:
LLamaChatPromptOptions["xtc"]) - DRY (Don't Repeat Yourself) repeat penalty (#553) (57e8c22) (documentation:
LLamaChatPromptOptions["dryRepeatPenalty"]) - Tiny Aya support (#553) (57e8c22)
Bug Fixes
- adjust the default VRAM padding config to reserve enough memory for compute buffers (#553) (57e8c22)
- support function call syntax with optional whitespace prefix (#553) (57e8c22)
- change the default value of
useDirectIotofalse(#553) (57e8c22) - Vulkan device dedupe (#553) (57e8c22)
Shipped with llama.cpp release b8095
To use the latest
llama.cpprelease available, runnpx -n node-llama-cpp source download --release latest. (learn more)