This release includes two new features:
- model macros (#330): macros can now be defined as part of a model's configuration. These take precedence over macros defined at the global level.
- model metadata (#333): metadata can now be defined in a model's configuration. This is a schema-less object that supports integers, floats, bools, strings, arrays and child objects. metadata fields also support macro substitution. Metadata is only used in the
v1/modelsendpoint under a new JSON key:meta.llamaswap.
Other smaller changes:
- macro values can be any integer, string, bools, or float types. This enhancement makes JSON encoding of metadata with macros behave as expected. Previously macro values could only be strings.