What’s New in Release 1.0
APIs & Schema
- Stabilized and improved the Schemas and APIs.
- The APIs are backward compatible from this release onwards
Ingestion
- Connecting to your data sources has never been easier. Find all the necessary permissions and connection details directly in the UI.
- When testing the connection, we now have a comprehensive list of validations to let you know which pieces of metadata can be extracted with the provided configuration.
- Performance improvements when extracting metadata from sources such as Snowflake, Redshift, Postgres, and dbt.
- New Apache Impala connector.
Storage Services
- Based on your feedback, we created a new service to extract metadata from your cloud storage.
- The Data Lake connector ingested one table per file, which covered only some of the use cases in a Data Platform. With Storage Services, you can present accurate metadata from your tables, even when partitioned.
- The first implementation has been done on S3, and we will keep adding support for other sources in the upcoming releases.
Dashboard Data Models
- Dashboard Services now support the concept of Data Models: data that can be directly defined and managed in the Dashboard tooling itself, e.g., LookML models in Looker.
- Data Models will help us close the gap between engineering and business by providing all the necessary metadata from sources typically used and managed by analysts or business users.
- The first implementation has been done for Tableau and Looker.
Queries
- Improved UI for SQL Queries, with faster loading times and allowing users to vote for popular queries!
- Users can now create and share a Query directly from the UI, linking it to multiple tables if needed.
Localization
- In 1.0, we have added Localization support for OpenMetadata.
- Now, you can use OpenMetadata in English, French, Chinese, Japanese, Portuguese, and Spanish.
Glossary
- New and Improved Glossary UI
- Easily search for Glossaries and any Glossary Term directly in the global search.
- Drag and drop Glossary Terms within and across Glossaries to adapt your Glossaries as you build them.
- Instead of searching and tagging their assets individually, users can add Glossary Terms to multiple assets from the Glossary UI.
Auto PII Classification
- Implemented an automated way to tag PII data.
- The auto-classification is an optional step of the Profiler workflow. We will analyze the column names, and if sample data is being ingested, we will run NLP models on top of it.
Search
- Improved Relevancy, with added support for partial matches.
- Improved Ranking, with most used or higher Tier assets at the top of the search.
- Support for Classifications and Glossaries in the global search.
Security
- SAML support has been added.
- Deprecation Notice: SSO Service accounts for Bots will be deprecated. JWT authentication will be the preferred method for creating Bots.
Lineage
- Enhanced Lineage UI to display a large number of nodes (1000+).
- Improved UI for better navigation.
- Improved SQL parser to extract lineage in the Lineage Workflows.
Chrome Browser Extension
- All the metadata is at your fingertips while browsing Looker, Superset, etc., with the OpenMetadata Chrome Browser Extension.
- Chrome extension supports Google SSO, Azure SSO, Okta, and AWS Cognito authentication.
- You can Install the Chrome extension from the Chrome Web Store.
New Contributors
- @geoHeil made their first contribution in #9853
- @pdeeparao made their first contribution in #9931
- @osocron made their first contribution in #9870
- @krotonet made their first contribution in #10110
- @rglbr made their first contribution in #10109
- @joe-shajan made their first contribution in #10194
- @yu-iskw made their first contribution in #10154
- @JINZHANG2017 made their first contribution in #10176
- @stephanesol made their first contribution in #10209
- @VolkovGeoPhy made their first contribution in #10218
- @awittzb made their first contribution in #10335
- @nuang-ee made their first contribution in #10340
- @kcd83 made their first contribution in #10370
- @SuperNascher made their first contribution in #10305
- @charliemenke made their first contribution in #10385
- @schlameel made their first contribution in #10403
- @megumiie made their first contribution in #10581
- @jan-pieter made their first contribution in #10664
- @Anuj359 made their first contribution in #10796
- @luis-fnogueira made their first contribution in #10730
- @ksirmons made their first contribution in #10944
- @Hemal-Mamtora made their first contribution in #10838
- @bohanhou14 made their first contribution in #5855
- @heroWang made their first contribution in #11042
- @BirdboyBolu made their first contribution in #11060
Full Changelog: 0.13.3-release...1.0.0-release