Access Control Policy
- New entities called ‘Role’ and ‘Policy’ have been added.
- A User has a ‘Role’. A ‘Policy’ can be assigned to a Role.
- A Policy has a set of ‘Rules’. Rules are used to provide access to functions like updateDescription, updateTags, updateOwner and so on.
- Can provide access to metadata operations on any entity.
- A standard set of Roles with their Policies have been added in the new release.
- ‘Admins’ and ‘Bots’ can perform any metadata operation on any entity.
- Admins can define policies through the Policy UI, and assign roles to the Users.
Manual Lineage
- Enhance the lineage captured from machine metadata with user knowledge.
- Users can edit the lineage and connect the entities with a no-code editor.
- Drag and drop UI has been designed to add lineage information manually for the table and column levels.
- Entities like table, pipeline, and dashboard can be dragged and dropped to the lineage graph to create a node.
- The required entity can be searched and clicked to insert into the graph.
Event Notification via Webhooks & Slack Integration
- Subscribe event notifications via webhooks.
- Send metadata change events as Slack notifications
- Provide timely updates to keep the data team informed of changes
Entity Deletion
- API support has been added for entity deletion, both for soft delete and hard delete.
- A deleted dataset is marked as deactivated in the OpenMetadata backend instead of hard deleting it.
- Ingestion support has been added to publish entity deletion.
- Enabled version support for deleted entities.
Version panel has been added for all the entities- Table, Topic, Pipeline, and Dashboard.
- Previously, we were getting the change descriptions for a limited set of fields for the Topic entity; several other fields have now been included.
New Connectors
- Supports Delta Lake, an open source project that enables building a Lakehouse architecture on top of data lakes.
- Worked on the refactor of SQL connectors to extract the lineage.
- Connector API was refactored to capture the configs on the OpenMetadata side and to schedule the ingestion via UI.
Other Features
- DataSource attribute has been added to the ML model entity.
- Python API has been updated to add lineage for ML Model entities.
- A new tab called ‘Bots’ has been added to group users with isBot set to true.
- Support Application Default Credentials or a keyless, default service account in BigQuery data ingestion.
- Includes a feature tour for new users.