3.0.0-beta.38 (2024-07-09)

Bug Fixes

• adapt to llama.cpp breaking changes (#266) (c35ff5a)
• Llama 3 Instruct function calling (#266) (c35ff5a)

Features

• flash attention in model selection (#266) (c35ff5a)

Shipped with llama.cpp release b3347

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)