github guidance-ai/guidance 0.2.5

one month ago

Guidance 0.2.5

Special tokens can be user-defined. Numerous grammar fixes. Candidate tokens rendered for all token types.

Added

  • Widget has dark mode (mainly for exporting).
  • special_token function added for adding in <think> and similar.

Changed

  • top_k exposed when echo=True for all token types (including fast-forward, inputs).
  • Use greedy samplng if temp is smaller than 1e-5.

Fixed

  • Normalized capture names not preserved, fixed.
  • Logit array fix internally to avoid interfering mutations.
  • top_k in widget is always 'unmasked' and not conditioned on mask.
  • Terminal rule indirection fix, improves performance in select cases

Don't miss a new guidance release

NewReleases is sending notifications on new releases.