v0.8.43
Highlights
User Experience
- Bulk edit support - you can now add or remove Owners, Glossary Terms, Tags, Domains, Deprecation Status to multiple entities with a few clicks!
- Improved user experience to create secrets and ingestion schedules
Developer/Community Experience
- A new Java-based file emitter, generating a JSON file that can be used in the “File” metadata ingestion source
- Delta Lake fixes to make it more stable and to extract table history to populate the operation aspect
Metadata Ingestion
- When ingesting metadata from the DataHub UI, you will now see an “Ingestion Run Summary” which shows the run outcome, number of entities successfully ingested, and the ability to download logs collected during the run
- New Dataset Domain Transformer - assign a Domain to Datasets during ingestion
Full Commit Log
What's Changed
- #5577 @jjoyce0510 feat(ui): Add rich UI ingestion run summary
- #5330 @liyuhui666 feat(ingest): clickhouse - add metadata modification time and data size
- #5582 @jjoyce0510 feat(ui): Support batch deleting from ui
- #5531 @Jiafi Fix profiling when using {table}.
- #5548 @Jiafi Expose catalog_name in athena.py
- #5335 @mohdsiddique feat(ingest): power-bi - make ownership ingestion optional
- #5587 @aditya-radhakrishnan fix(groups): fix user, search, and preview group membership to be fetched for both external and native group memberships
- #5586 @xiphl feat(ui): make container description searchable and have description show up in results
- #5585 @mohdsiddique fix apache ranger plugin readme file rendering
- #5277 @MugdhaHardikar-GSLab feat(ingest): delta-lake - extract table history into operation aspect
- #5584 @shirshanka fix(ingest): moving delta-lake connector to be 3.7+ only
- #5526 @MugdhaHardikar-GSLab fix(ingest): sql-common - db2, snowflake bug fixes to extract table descriptions
- #5566 @hsheth2 feat(ingest): infer aspectName from aspect type in MCP
- #5578 @MugdhaHardikar-GSLab feat(datahub-client): add java file emitter
- #5328 @Santhin feat(ingest): dbt - control over emitting test_results, test_definitions, etc.
- #5547 @hsheth2 fix(ingest): handle when current server version is unavailable
- #5579 @chriscollins3456 feat(ingestion) Add Save & Run button to managed ingestion builder
- #5558 @anshbansal feat(test): add read-only smoke tests
- #5581 @maggiehays chore(gradle): update node version for docs site
- #5580 @jjoyce0510 fix(ui): Fixing batch set domains bug
- #5574 @chriscollins3456 feat(ingestion) Implement secrets in new managed ingestion form
- #4976 @NoahFournier feat(graphql): add MutableTypeBatchResolver
- #5572 @jjoyce0510 feat(ui): Support batch deprecation from the UI (Batch actions part 6/7)
- #5575 @gabe-lyons extending assertion std model
- #5560 @jjoyce0510 feat(ui): Batch set & unset Domain for assets via the UI
- #5571 @anshbansal chore(build): tweak stale issue timing
- #5570 @anshbansal fix(gms): missing directory for gms
- #5569 @anshbansal fix(ci): flaky smoke test fix
- #5568 @anshbansal fix(gms): ensure directory is present
- #5562 @gabe-lyons (chore): upgrading ingestion to 0.8.42
- #5551 @hsheth2 fix(ingest): activate mypy support for ParamSpec typing annotation
- #5563 @gabe-lyons chore(0.8.42): update breaking changes doc
- #5456 @mohdsiddique feat(transformers): Add domain transformer for dataset
- #5564 @hsheth2 fix(ingest): fix some typos and logging issues
- #5444 @xiphl feat(ingest) Allow ingestion of Elasticsearch index template
- #5541 @ms32035 fix(ingestion): correct trino datatype handling
- #5559 @chriscollins3456 feat(ingestion) Update managed ingestion scheduler to be easier to use
- #5552 @jjoyce0510 feat(ui): Batch add & remove Owners to assets via the UI