guidance-ai/guidance 0.1.14

on GitHub

This release brings a series of new features, bug fixes, and changes, including:

• Improved compatibility for loading many transformers models, including newly tested support for Phi-3
• New capabilities in the guidance.json function for generating json, including early support for pydantic schemas.
• Support for AzureAI models in new guidance.models.AzureAIStudio* classes
• Significant dependency reductions on the default guidance installation
• Small grammar optimizations
• Many improvements to the infrastructure, testing, and release pipelines :)

What's Changed

• replace catches of the ImportError exception with the more specific ModuleNotFoundError exception by @paulbkoch in #733
• fix for issue #660 where the call to llama_batch_free is failing during process shutdown by @paulbkoch in #734
• Fix #713 for mistral models in transformers by @slundberg in #740
• Update JSON API and example notebook by @riedgar-ms in #699
• remove redundant options from select() by @mmoskal in #712
• Add support for prefixItems, minItems, and maxItems for JSON array generation by @hudson-ai in #732
• [Docs] Expand documentation by @riedgar-ms in #750
• Generation with pydantic schemas by @hudson-ai in #724
• First stab at minimal mypy implementation by @ryanpeach in #738
• remove openai hard dependency by @slundberg in #763
• from guidance import guidance by @ryanpeach in #759
• Run black on codebase by @Harsha-Nori in #765
• add rust bindings by @paulbkoch in #736
• fix Transformers tokenizer issues when models have extended vocabulary and/or special tokens by @Harsha-Nori in #766
• [Install] Rework optional imports by @riedgar-ms in #767
• Update _llama_cpp.py based on new contract of llama_get_logits by @czoccolo in #769
• [Bug] Missing support for AzureAI by @riedgar-ms in #770
• [Doc] Add developer notes by @riedgar-ms in #774
• [Feature] Improved JSON Schema support by @riedgar-ms in #787
• [Bug] Fix Regex for identifying OpenAI models by @alexander-brady in #778
• Fix models like phi-3 which have a mismatched tokenizer definition and model output tensor size by @Harsha-Nori in #792
• [Feature] Add temperature to JSON generator by @riedgar-ms in #784
• [Feature] Support for Azure AI Studio by @riedgar-ms in #779
• Add guard for running build from setup.py, redirecting users to pip by @Harsha-Nori in #805
• Many testing and CI improvements by @riedgar-ms

New Contributors

• @mmoskal made their first contribution in #712
• @ryanpeach made their first contribution in #738
• @czoccolo made their first contribution in #769
• @alexander-brady made their first contribution in #778

Full Changelog: 0.1.13...0.1.14