Notice! This version has a few known bugs regarding revocable access tokens. Specifically, the UI for listing access tokens does not work properly unless you have a specific platform privilege. Additionally, there is a delay in revoking access tokens of 6 hours. We recommend that you skip this version and upgrade directly to v0.8.38.
Highlights
User Experience
This release comes packed full of new features and updates.
- NEW – Create & Revoke Access Tokens via the UI - Find this under Settings > Developer. This replaces the previous stateless tokens UI.
- NEW – Create and Invite Users to DataHub via the UI - Find this under Users & Groups > Invite DataHub users. Admins can also now generate password reset links for their users.
- NEW - Manage Related Glossary Terms via the UI - Add and remove Glossary Terms Contained By and Inherited From a parent via the UI. Find this under Glossary
- UPDATE - Rename “Manage” navigation item to “Govern”
- [IMPORTANT] UPDATE - Move “Users & Groups” navigation item into Settings > Access
- [IMPORTANT] UPDATE - Move “Policies” navigation item into Settings > Access (Privileges)
- FIX - You no longer need to run a reindexing job to start using the new Business Glossary UI. This process is handled for you at boot time.
- Minor fixes & improvements to UI for adding policy users + groups.
Metadata Ingestion
- Support Snowflake ingest via Oauth
- Misc fixes and improvements to existing ingestion sources
What's Changed
- feat(docs): auto-open config section for ingestion sources by @shirshanka in #5075
- feat(spark-lineage): coalesce spark jobs by @MugdhaHardikar-GSLab in #5077
- refactor(ui): UI Navigation Refactoring by @jjoyce0510 in #5076
- Update docs to alert users to restore indices for their Glossary by @chriscollins3456 in #5082
- fix(restore-indices): Do not fail while working with each row by @dexter-mh-lee in #5084
- fix(ingestion): looker - Handling gracefully invalid json in query dynamic field by @treff7es in #5083
- feat(docs): ingest - add tab for config json schema by @shirshanka in #5086
- chore(dep): upgrade json-smart by @RyanHolstien in #5081
- feat(ingest): rest_emitter - Adding option to rest emitter to disable ssl verification by @treff7es in #5042
- feat(cli): suggest upgrades when appropriate by @shirshanka in #5091
- feat(doc): Generating json schema for ingestion recipes by @treff7es in #5092
- feat(ingest): snowflake using oauth by @saxo-lalrishav in #4647
- fix(ui): do not show copy URN buttons when Clipboard API is not available by @Masterchen09 in #5087
- feat(kafka): use a thread pool executor for kafka for thread reuse by @RyanHolstien in #5079
- Manage Access Tokens by @Ankit-Keshari-Vituity in #5067
- tests(lookml): adding tests for model deny patterns by @gabe-lyons in #4934
- feat(model): Add optional context field to tag/term association by @dexter-mh-lee in #5085
- fix(glossary) Two quick followup fixes around the new Glossary updates by @chriscollins3456 in #5065
- chore(deps): bump eventsource from 1.1.0 to 1.1.1 in /docs-website by @dependabot in #5057
- feat(oidc): add configurable read timeout by @RyanHolstien in #5088
- feat(glossary) Display Incoming 'IsA' Glossary related entities by @chriscollins3456 in #5063
- fix(profiling): don't stop if some steps fail by @anshbansal in #5095
- feat(upgrades) Create new DataHubUpgrade + Restore Glossary Entities Bootstrap step by @chriscollins3456 in #5099
- fix(deps): ingest - moving packaging to framework_common by @shirshanka in #5096
- feat(frontend) Allow overriding akka-max-header-value-length by @karoliskascenas in #5094
- refactor(graphql): Migrate Visual Config into the Configuration Provider by @jjoyce0510 in #4780
- chore(akka): upgrade akka http for vuln by @RyanHolstien in #5100
- fix(build): reduce time taken for resolution by @anshbansal in #5106
- fix(build): remove dependencies added for compatibility by @anshbansal in #5108
- fix(ci): pin google-cloud-logging to avoid pip backtracking by @shirshanka in #5109
- Policies page issue by @Ankit-Keshari-Vituity in #5107
- chore(deps): Bump spring to 5.3.20 for vuln fix by @pedro93 in #5110
- fix(cli): Bumping avro-gen3 to 0.7.4 by @jjoyce0510 in #5098
- feat(docs): Updating example files with the new ingestion recipe suffix by @treff7es in #5103
- feat(graphql): add graphql endpoint to check whether an entity exists by @aditya-radhakrishnan in #5102
- feat(looker): ensure explore name matches looker's display name by @shirshanka in #5111
- fix(ui): Fixing missing homescreen logo by @jjoyce0510 in #5112
- fix(dbt): final fix of dbt platform instance issues by @gabe-lyons in #5115
- feat(ingestion): bigquery-usage - Collect stats from read event reasons by @treff7es in #5118
- feat(terms) Add ability to Add and Remove Related Terms to Glossary Terms by @chriscollins3456 in #5120
- Fixed Issue : Add Members Modal by @Ankit-Keshari-Vituity in #5117
- fix(bigquery): handling of empty partitioned tables, improve report message by @anshbansal in #5122
- feat(glossary) Hide self and children from select when moving a GlossaryNode by @chriscollins3456 in #5123
- fix(ingestion): bigquery-usage - Removing filtering at queryevents by @treff7es in #5124
- feat(users): add ability to add native users from the UI by @aditya-radhakrishnan in #5097
- fix(ingestion): Looker original view name should be used for explore_joins by @sebkim in #4928
- fix(iceberg): Change how MapType are mapped to Avro to support complex Map key type by @cccs-eric in #5060
- fix(ingestion): bigquery-usage - Only send operational metadata for allowed tables by @treff7es in #5127
- fix(dbt): Validator error fix by @BoyuanZhangDE in #5125
- feat(settings): skip calling graphql hooks if user does not have the right permissions by @aditya-radhakrishnan in #5136
Full Changelog: v0.8.36...v0.8.37