✨ gpt-oss is here! ✨

Read about the release in the blog post

3.12.1 (2025-08-11)

Features

• comment segment budget (#489) (30eaa23) (documentation: API: LLamaChatPromptOptions["budgets"]["commentTokens"])
• Electron template: comment segments
• Electron template: improve completions speed when using functions

Bug Fixes

• gpt-oss segment budgets (#489) (30eaa23)
• add support for more gpt-oss variations (#489) (30eaa23)
• default to using a model message for prompt completion on unsupported models (#489) (30eaa23)
• prompt completion config (#490) (f849cd9)

Shipped with llama.cpp release b6133

To use the latest llama.cpp release available, run npx -n node-llama-cpp source download --release latest. (learn more)