What's Changed
- Temperature controls now work for remote models.
- When optimistically running remote models grammar violations now have much better error messages/debugability.
- Huggingface transformers models now fully respect the training tokenization patterns.
- DOC Update notebooks by @riedgar-ms in #491
- Update tutorial for Azure OpenAI by @riedgar-ms in #468
- move llama.cpp batch object allocation into a separately allocated co… by @paulbkoch in #508
- Drop unused
nest_asyncioby @evelkey in #510 - Fixed compile error when using Microsoft toolchain. by @wmiller in #511
- Using
Modelin a loop by @riedgar-ms in #512 - Set base_url default as None and remove redundant setting by @tshu-w in #519
- Adding outputs for Azure notebook by @riedgar-ms in #533
- Further notebook updates by @riedgar-ms in #522
- Update tutorial.ipynb by @mwieler in #534
New Contributors
- @evelkey made their first contribution in #510
- @wmiller made their first contribution in #511
- @tshu-w made their first contribution in #519
- @mwieler made their first contribution in #534
Full Changelog: 0.1.6...0.1.7