Release Highlights

Known Issues

• In embedded search experiences (Glossary Terms, Domains, Lineage), filters can become "locked" in place once selected. This is addressed in v0.9.2

User Experience

• Column-level Impact Analysis is here! You can now see the full end-to-end list of column dependencies; watch the demo here

• When creating a Glossary Term from the UI, you can now add the description in the same step

• We now support adding Domains to Glossary Terms

• You can now preview Entity Names and Types in browser tabs

• Login with SSO button on the login page.

Bug Fixes

• Assertions Tab functionality is restored
• SSO: Continuous login loop bug reported when the session cookie size exceed 4096 characters has been address.
• Ingestion scheduler for > 30 ingestion sources is now fixed. Previously there was a bug causing certain ingestion to become unscheduled.

Metadata Ingestion

• New Ingestion Source: Databricks Unity Catalog - check out the docs here
• Tableau: Column-level lineage and Stateful Ingestion are now supported
• LookML: Improved column-level lineage
• BigQuery: we have promoted bigqery-beta to bigquery
• Snowflake: Stateful Ingestion now supports deleting Containers

DataHub Docs Site

We continue to push improved feature guides to the DataHub docs site, including:

• Sync Status
• DataHub Roles
• Dataset Usage and Query History
• DataHub Access Policies
• Managed DataHub Metadata Tests

What's Changed

• feat(ui): looker, lookml - add banner to cross-link ingestion by @Ankit-Keshari-Vituity in #6111
• feat(ingest): infer aspect name from type in get_aspect by @hsheth2 in #6033
• feat(ingestion): Tableau stateful ingestion by @amanda-her in #6094
• feat(ingest): include raw s3 paths if s3 source by @hsheth2 in #6168
• feat(secrets) Allow creating secrets with multiline values in the UI by @chriscollins3456 in #6169
• feat(ingest/tableau): support dashboard tags by @hsheth2 in #6185
• feat(ingest): bigquery-beta - Parsing view ddl definition for lineage by @treff7es in #6187
• fix(ingest) - bigquery-beta - Using table ref instead of table id by @treff7es in #6193
• docs(roles): update roles docs to new doc format by @aditya-radhakrishnan in #6175
• docs(posts): add posts feature guide by @aditya-radhakrishnan in #6184
• feat(ingest): include instance in container dataPlatform when provided by @hsheth2 in #6083
• feat(telemetry): add telemetry events to the settings page by @aditya-radhakrishnan in #6198
• Worked to update the ingestion type while editing by @Ankit-Keshari-Vituity in #6156
• fix(ingest): add lower bound for ujson dep version by @hsheth2 in #6189
• feat(ingest/tableau): emit status aspects + streamline stateful ingestion by @hsheth2 in #6188
• feat(ingest): support self-signed certs in Tableau by @hsheth2 in #6172
• fix(ingest): report warning/error counts correctly by @hsheth2 in #6128
• fix(ingest): Closeable as a context manager by @hsheth2 in #6067
• feat(ingestion-ui) Add new form for the bigquery-beta connector by @chriscollins3456 in #6200
• feat(ingest): add platform instance to tableau by @alaponin in #5978
• feat(release): bump CLI version to 0.9.0 by @szalai1 in #6195
• fix(frontend): fix UI message in create group modal by @liyuhui666 in #6205
• docs: dataset usage and query history feature guide by @treff7es in #5900
• fix(glossary) Improve business glossary loading performance by @chriscollins3456 in #6208
• feat(ingest): replace base85's pickle with json by @hsheth2 in #6178
• docs: add sync status feature guide by @hsheth2 in #5897
• feat(frontend): add custom ssl truststore settings by @alexey-kravtsov in #6090
• docs(spark): add configuration instructions for databricks by @mayurinehate in #6206
• fix(ingest): use corpGroup instead of corpgroup by @hsheth2 in #6202
• build: upgrade gradle wrapper by @hsheth2 in #6203
• fix(ingest): catch errors when profiling for sample values by @mayurinehate in #6194
• fix(ingest): only restrict GE version for hive by @hsheth2 in #6170
• feat(ingest/GE): enable debug logs to stdout when DATAHUB_DEBUG env var is set by @mayurinehate in #6192
• feat(ingest): allow selfsigned certificate in s3 source by @mayurinehate in #6179
• build(ingest): remove markupsafe dep and bump pytest-docker by @hsheth2 in #6201
• docs(access policies): Creating Proper Access Policies Guide by @jjoyce0510 in #6001
• feat(ingest): support deletion of containers in snowflake stateful in… by @mayurinehate in #6180
• fix(glossary) Improve performance when getting root glossary terms by @chriscollins3456 in #6214
• fix(ui) Fix bigquery and redshift forms for lineage fields by @chriscollins3456 in #6215
• fix(ui) Properly display column-level lineage with v2 field paths by @chriscollins3456 in #6217
• fix(ingest): bigquery-beta - Add stacktrace to bigquery schema ingest logs by @treff7es in #6226
• tests(embedded search): adding domain & container tests by @gabe-lyons in #6221
• fix(docs): fix pdl link for mxe docs by @aditya-radhakrishnan in #6230
• feat(telemetry): add telemetry events to the glossary, domains, and managed ingestion pages by @aditya-radhakrishnan in #6216
• fix(ingest): bigquery-beta - Adding python 3.8 fix for memory footprint util by @treff7es in #6228
• docs(quickstart): enable slack community link by @jx2lee in #6209
• fix(build): allow image tag via env, fix requirements by @anshbansal in #6237
• fix(ingest): remove back-ticks from table name when creating urn by @mayurinehate in #6236
• feat(ingest): bigquery-beta - Add option to lowercase urns by @treff7es in #6240
• fix(ingest): presto-on-hive - Adding db name to the presto on hive urn by @treff7es in #6024
• Worked on the CSS issue of Add Owners Modal by @Ankit-Keshari-Vituity in #6223
• fix(ingest): stateful-ingestion - keep dataset urn case in checkpoints by @treff7es in #6244
• Create Tag Modal Issue: Clear the input value on press. by @Ankit-Keshari-Vituity in #6212
• feat(build): add cypress tests for glossary and deprecation by @anshbansal in #6249
• feat(ingest): hive-on-presto - Add option to properly filter hive schemas by @treff7es in #6247
• fix(ingest):lookml - better column-level lineage, hive urn generation… by @shirshanka in #6254
• fix(ingestion scheduler): Fix bug where ingestion is unscheduled for > 30 ingestion sources. by @jjoyce0510 in #6256
• fix(oidc): Avoid storing Pac4j profile in cookie by @jjoyce0510 in #6260
• docs(browse): add documentation on browse feature by @RyanHolstien in #5941
• feat(ui-ingestion) Add test connection button to bigquery-beta form by @chriscollins3456 in #6248
• docs(logo) update thoughtworks logo by @maggiehays in #6266
• feat(metrics): add metrics around search caching by @RyanHolstien in #6255
• feat(ui): display entity names in browser tab titles by @ngamanda in #6225
• fix(oidc): change default oidc username claim to be email by @aditya-radhakrishnan in #6220
• fix(ui): repair display name of MongoDB source by @wirelessr in #6270
• feat(ui) Display 'View in Github' if externalUrl is link to GitHub by @chriscollins3456 in #6253
• fix(ingest): looker - deps, column level lineage fixes by @shirshanka in #6271
• Adding Domain to Glossary Terms by @Ankit-Keshari-Vituity in #6135
• test(neo4j): Improve test performance by @david-leifker in #6142
• Dynamic width of the pop-overs by @Ankit-Keshari-Vituity in #6238
• feat(ingest/kakfa-connect): support generic connectors by @BoyuanZhangDE in #6173
• fix(ingestion): passing disable_ssl_verification param value to DatahubRestEmitter by @AdamDz in #6241
• feat(ingest): allow for deleting aspects in cli with -p tag by @Anirudh181001 in #6190
• fix(quickstart): support for user-level sockets, arch option for forcing quickstart architecture by @shirshanka in #6279
• fix(posts): render link posts dynamically and fix margin by @aditya-radhakrishnan in #6234
• docs(lookml): add docs for multi-project lookml ingestion by @shirshanka in #6284
• fix(ui) Fix two lineage visualization bugs by @chriscollins3456 in #6278
• feat(ingest): bigquery - Promoting bigquery-beta to bigquery source by @treff7es in #6222
• fix(adv search): two advanced search fixes by @gabe-lyons in #6252
• feat(lineage) Add column-level impact analysis feature by @chriscollins3456 in #6272
• feat(docs): Adding Managed DataHub Metadata Tests Guide by @jjoyce0510 in #6219
• fix: only add failure report on exception and process view and table by @abelstam12 in #6242
• refractor(ingest): update field name for snowflake column lineage by @mayurinehate in #6263
• docs(getting started) Update Getting Started landing page by @maggiehays in #6282
• docs(adopter) adding ClassDojo logo to website by @maggiehays in #6293
• feat(ingest): add support for column level lineage in tableau by @mayurinehate in #6264
• fix(ingest/dbt): lowercase external urns + cleanup config by @hsheth2 in #6289
• fix(ingest/tableau): add extra debug info for lineage failure by @hsheth2 in #6285
• fix(assertion tab): fixing up regression in assertion resolver by @gabe-lyons in #6296
• feat: make platform for spark lineage inferred and configurable by @danielli-ziprecruiter in #6251
• refactor(docs): Minor docs refactoring by @jjoyce0510 in #6300
• fix(roles): move search button to right side of screen by @aditya-radhakrishnan in #6306
• feat(ingest/mssql): add type mappings for BIT and SQL_VARIANT by @hsheth2 in #6304
• feat(ingest): add fallthrough support to KeyValuePattern by @hsheth2 in #6302
• feat(ui) Allow a user to type in a custom value in ingestion Secret Fields by @chriscollins3456 in #6301
• feat(ui) Add documentation to term/node creation modal by @chriscollins3456 in #6294
• fix(spark-lineage): Rename table.platform to table.hive_platform_alias by @treff7es in #6311
• fix(docs): fix custom transformer example interface by @DSchmidtDev in #6309
• feat(ui) Display inputFields in column-lineage visualization by @chriscollins3456 in #6303
• ci: Up to date actions addressing warnings in builds. by @kevinneville in #6308
• feat(ingest): unity-catalog - Unity catalog source by @treff7es in #6292
• fix(logs): fix logged variable on looker sdk error by @mayurinehate in #6319
• feat(ui) Update bigquery UI ingestion source to be the same as bigquery-beta by @chriscollins3456 in #6283

New Contributors

• @alaponin made their first contribution in #5978
• @jx2lee made their first contribution in #6209
• @wirelessr made their first contribution in #6270
• @AdamDz made their first contribution in #6241
• @Anirudh181001 made their first contribution in #6190
• @abelstam12 made their first contribution in #6242
• @danielli-ziprecruiter made their first contribution in #6251

Full Changelog: v0.9.0...v0.9.1