github guidance-ai/guidance 0.1.6

latest releases: 0.2.0rc1, 0.1.16, 0.1.15...
pre-release9 months ago

What's Changed

  • preliminary support for log_probs using the compute_log_probs=True model constructor arg.
  • A new guidance.cpp module that allows us to have high speed implementations of key objects.
  • reduce memory requirements (and probably improve speed) for llama.cpp tests by @paulbkoch in #485
  • Many bug fixes :)

Full Changelog: 0.1.5...0.1.6

Don't miss a new guidance release

NewReleases is sending notifications on new releases.