v1.6.0 Alpha 3 Release Notes

This major release contains breaking changes, please read the breaking changes section before upgrading. It adds support for structured output and a new Timeline API.

⚠️ Breaking Changes

To avoid confusion with LLM Vision Memory:

• The remember action is now called create_event
• The remember parameter has been renamed to store_in_timeline.

Please make sure to update these in your custom automations. If you use the blueprint, make sure to update to the latest version.

If you use LLM Vision Cards, please update to v1.6.0 as well. The card now uses the new Timeline API, and older versions are no longer supported.

Contributors

A huge thank you to our contributors @rmaher001, @Smiley73, @muminkoykiran, @boian-ivanov, @ljmerza, @radzio, and @TheRealFalseReality!

Integration

✨ Features

• Structured Output: Valid JSON output can now be forced using the structure parameter. See the docs for more details. (by @rmaher001)
• Timeline API: Events stored in the timeline can now be fetched through the new Timeline API. The LLM Vision Cards use this API, but you can also use it for your own automations or to integrate third-party services. See the API docs for more details. (by @valentinfrlch)
• Event classification: Events are now classified into categories and labels. For custom events, these can be assigned manually using the create_event action. For events that are automatically added through an analyzer or the blueprint, category and label is assigned automatically. For a full list of all available categories and labels, see the docs. (by @valentinfrlch)

🔧 Improvements & Bug Fixes

• Create Events: The create_events action now supports setting the category and (new) label for an event manually. (#536) (by @valentinfrlch)
• Request Timeout: The request timeout is now configurable (useful for local LLMs that may need more time to respond). (by @ljmerza)
• Timeline: Fixed an issue that caused images to be removed before the event was created, resulting in broken notifications and timeline cards. (#551) (by @valentinfrlch)
• Special Characters: Improved handling of special characters in event titles (by @radzio)
• Unavailable Cameras: Added checks to detect if a camera is offline. Only raises an error if all cameras are unavailable. (by @rmaher001)
• Unit Test Coverage: Added unit tests. (by @Smiley73)
• Fixed a bad request issue during inital setup. (#574) (by @valentinfrlch)
• Pinned boto3 to 1.37.1 to avoid conflicts with other integrations (#580) (by @valentinfrlch)

🌐 Languages

• Support for Hungarian language: Added 🇧🇬 Bulgarian translations. (by @boian-ivanov)
• Support for Turkish language: Added 🇹🇷 Turkish translations. (by @muminkoykiran)

Blueprint

For this alpha, please import the blueprint using this url:

https://github.com/valentinfrlch/ha-llmvision/blob/v1.6.0-beta/blueprints/event_summary_beta.yaml

If you're having this issue on an existing blueprint, set this new option explicitly so it changes from the unknown {{ camera }} variable to a static "LLM Vision Snapshot" group.

🔧 Improvements & Bug Fixes

• Importance Classification: The system prompt to classify important events is now configurable. (by @TheRealFalseReality)
• Fixes the “camera is undefined” error. (by @TheRealFalseReality)