Guidance 0.2.5
Special tokens can be user-defined. Numerous grammar fixes. Candidate tokens rendered for all token types.
Added
- Widget has dark mode (mainly for exporting).
special_token
function added for adding in<think>
and similar.
Changed
top_k
exposed whenecho=True
for all token types (including fast-forward, inputs).- Use greedy samplng if temp is smaller than
1e-5
.
Fixed
- Normalized capture names not preserved, fixed.
- Logit array fix internally to avoid interfering mutations.
top_k
in widget is always 'unmasked' and not conditioned on mask.- Terminal rule indirection fix, improves performance in select cases