What's Changed
0.10.5 is a release that focused on making the "sync with upstream llama.cpp" task simpler and better. In the span of 2 weeks we performed three syncs and took advantage of these iterations to improve the llamafile skill/plugin for AI agents. The result is a better process that provides more reliable code, requiring fewer iterations to go from an auto-generated draft PR to the final merged code. As a byproduct, llamafile now supports very recent models such as Ternary Bonsai 27B and Laguna-S-2.1.
Thanks to our community's contributions, this release also brings significant documentation updates clarifying the new help system, the difference between different lllamafile executables, and up-to-date llamafile GPU support. Many thanks everyone for the huge help!
- Update llama.cpp to b10052 (b2dd28a) by @aittalam in #1021
- Update llama.cpp to b10083 (846e991) by @aittalam in #1026
- Improve llamacpp update skill by @aittalam in #1027
- Update llama.cpp to b10103 (c588c4f) by @aittalam in #1030
- docs(quickstart): clarify llamafile vs llamafile-thin and other release binaries (#1022) by @Anai-Guo in #1023
- build(install): install transcribefile so it ships as a release artifact (#1035) by @Anai-Guo in #1036
- Fix typo in README.md for 'architectures' by @shawntax in #1031
- docs: Add docs for cli args and tools by @angpt in #1037
- docs(support): document the Vulkan GPU backend (#1029) by @Anai-Guo in #1033
New Contributors
Full Changelog: 0.10.4...0.10.5