What's Changed
- Check '--model-dir' for no models warning in one-click-installer by @jllllll in #4067
- Supercharging superbooga by @HideLord in #3272
- Fix old install migration for WSL installer by @jllllll in #4093
- Expand MacOS llama.cpp support in requirements.txt by @jllllll in #4094
- Bump exllamav2 to 0.0.4 and use pre-built wheels by @jllllll in #4095
- Enable NUMA feature for llama_cpp_python by @StoyanStAtanasov in #4040
- fix: add missing superboogav2 dep by @sammcj in #4099
- Delete extensions/Training_PRO/readme.md by @missionfloyd in #4112
- Bump llama-cpp-python to 0.2.7 by @jllllll in #4110
- fix: update superboogav2
requirements.txtby @wangcx18 in #4100 - Update one_click.py to initialize site_packages_path variable by @Psynbiotik in #4118
- Let model downloader download *.tiktoken as well by @happyme531 in #4121
- Bump llama-cpp-python to 0.2.11 by @jllllll in #4142
- Add grammar to transformers and _HF loaders by @oobabooga in #4091
- Ignoring custom changes to CMD_FLAGS.txt on update. by @berkut1 in #4181
- Fix off-by-one error in exllama_hf caching logic by @tdrussell in #4145
- AutoAWQ: initial support by @cal066 in #3999
- Bump ExLlamaV2 to 0.0.5 by @turboderp in #4186
- Bump AutoAWQ to v0.1.4 by @casper-hansen in #4203
- Fix python wheels for avx requirements by @AG-w in #4189
- Bump to pytorch 11.8 by @oobabooga in #4209
- Use GPTQ wheels compatible with Pytorch 2.1 by @jllllll in #4210
- Fix CFG init with Llamacpp_HF by @bdashore3 in #4219
- Text Generation: Abort if EOS token is reached by @bdashore3 in #4213
- README for superboogav2 by @jamesbraza in #4212
- Move import in llama_attn_hijack.py by @Ph0rk0z in #4231
New Contributors
- @StoyanStAtanasov made their first contribution in #4040
- @Psynbiotik made their first contribution in #4118
- @turboderp made their first contribution in #4186
- @casper-hansen made their first contribution in #4203
- @AG-w made their first contribution in #4189
- @bdashore3 made their first contribution in #4219
Full Changelog: 1.6.1...v1.7