Highlights
User Experience
- Performance improvements in the UI
- Improvements in CSV connector for easier ingestion - description, ownership, domain support added
- UI form for Snowflake Managed Ingestion so you don't have to make changes in YAML
- Viewing Siblings
Developer Experience
- Ability to stop quickstart instead of nuking
- Customizing mapped ports in quickstart
- New models for dashboard usage
- Circuit breaker and python api for Assertion and Operation
Metadata Ingestion
- Improvements in bigquery connector to only profile some tables
- Intermittent 401 errors during ingestion fixed
- New salesforce connector
What's Changed
- fix(test): add cleanup in tests, make urls configurable by @anshbansal in #5287
- fix(docs,quickstart): release related changes for 0.8.40 by @anshbansal in #5299
- [Deployment]: fix config typo on confluent cloud by @tengis in #5293
- fix(cli): suppress secrets in stacktraces by @anshbansal in #5302
- refactor(ui): Fix settings page divider by @jjoyce0510 in #5292
- fix(cli): timeline - category should be owner not ownership by @shirshanka in #5304
- perf(siblings): reduce data fetched by siblings in lineage by @gabe-lyons in #5308
- fix(ingest): bigquery - Fix for bigquery error when there was no bigquery catalog specified by @treff7es in #5303
- fix(ui) Fix entity profile sidebar width issues by @chriscollins3456 in #5305
- perf(search): Improve search default performance by @jjoyce0510 in #5311
- perf(ui): Performance improvements and misc refactorings in the UI by @jjoyce0510 in #5310
- Modified the drop down of Menu Items by @Ankit-Keshari-Vituity in #5301
- fix(validation) Fail validation error silently instead of crashing by @chriscollins3456 in #5314
- feat(docs) Add documentation on authorization & authentication by @pedro93 in #5265
- fix(ui) Make profile icon clickable to expand header menu by @chriscollins3456 in #5317
- refactor(ui): Extract searchable page into its own component (perf + ux) by @jjoyce0510 in #5318
- fix(gms) Remove auto-creating status aspect if not present when ingesting by @pedro93 in #5315
- fix(ui): Add missing SearchRoutes component by @jjoyce0510 in #5321
- feat(ingest): Ingest Looker dashboard create/update/delete timestamps by @mayurinehate in #5312
- fix(ui): Fix pipeline tasks list loading by @jjoyce0510 in #5332
- feat(ingest): lookml - adding support for only emitting reachable vie… by @shirshanka in #5333
- fix(ingest): omit schema fields when name is absent by @mayurinehate in #5275
- fix(siblings) Combine siblings data but remove duplicate data by @chriscollins3456 in #5337
- Fix typo in metadata-ingestion.md by @dougpm in #5338
- fix(me) Cache the me query for performance reasons by @chriscollins3456 in #5316
- fix(tokens) Adds non-admin tests for access tokens by @pedro93 in #5174
- feat(bigquery): support size, rowcount, lastmodified based table selection for profiling by @MugdhaHardikar-GSLab in #5329
- chore: Refactor Python Codebase by @koconder in #5113
- docs(bigquery): profiling report enhancement by @MugdhaHardikar-GSLab in #5342
- feat(ingest): update CSV source to support description and ownership type by @aditya-radhakrishnan in #5346
- Fixed UI issue: Tags list going outside the container by @Ankit-Keshari-Vituity in #5341
- feat(ingest): add salesforce connector by @mayurinehate in #5104
- feat(bootstrap): create abstract class UpgradeStep to abstract away upgrade logic by @aditya-radhakrishnan in #5349
- fix(bigquery-usage): dataset name fix for sharded tables by @MugdhaHardikar-GSLab in #5347
- docs(features): update grammar on Features overview by @maggiehays in #5350
- fix(ci): fix mysql and kafka-connect ingestion test by @shirshanka in #5352
- feat(ui): add copy function for stats table sample value by @ngamanda in #5331
- fix(ui) Correct show/hide tabs in Settings based on privileges by @chriscollins3456 in #5355
- fix(siblings): add useMutationUrn to domain section by @gabe-lyons in #5270
- feat(schema) Show last observed timestamp in the schema tab by @chriscollins3456 in #5348
- fix(glossary) Fixes a bug for yaml ingested terms without source_url by @chriscollins3456 in #5356
- feat(lineage) Add Lineage tab to Chart and Dashboard entity profiles by @chriscollins3456 in #5357
- fix(cassandra): fix Cassandra queries used by IngestDataPlatformInstancesStep by @justinas-marozas in #5199
- refactor(ui): Use createTag mutation for creating new tags from the UI by @jjoyce0510 in #5359
- Added recommendation on group modal by @Ankit-Keshari-Vituity in #5362
- refactor(ui): Remove unnecessary fields in GraphQL queries by @jjoyce0510 in #5358
- feat(ingest) - add audit actor urn to auditStamp by @neojunjie in #5264
- feat(ingest): Domain ingestion usability by @shirshanka in #5366
- fix(config): fixes config key in DataHubAuthorizerFactory by @sgomezvillamor in #5371
- fix(ingest): domains - check whether urn based domain exists during r… by @shirshanka in #5373
- feat(quickstart): Adding env variables and cli options for customizing mapped ports in quickstart by @NavinSharma13 in #5353
- fix(build): tweak ingestion build by @anshbansal in #5374
- feat(query) Add get_entity_v2 to python package by @aezomz in #5255
- fix(airflow): Fix for failing serialisation when Param was specified + support for external task sensor by @treff7es in #5368
- fix(users): fix to not get invite token unless the invite token modal is visible by @aditya-radhakrishnan in #5380
- fix(gms): Propagate token cache error by @pedro93 in #5381
- fix(bootstrap): skip ingesting data platforms that already exist by @aditya-radhakrishnan in #5382
- fix(cli): respect server telemetry settings correctly by @treff7es in #5384
- fix(ingest): bigquery - Graceful bq partition id date parsing failure by @treff7es in #5386
- feat(airflow): Circuit breaker and python api for Assertion and Operation by @treff7es in #5196
- feat(kafka-setup): add options for sasl_plaintext by @abiwill in #5385
- fix(bigquery): multi-project GCP setup run query through correct project by @anshbansal in #5393
- fix(bigquery): add storage project name by @anshbansal in #5395
- Add Changes to support smoke test on Datahub deployed on kubernetes Cluster by @NavinSharma13 in #5334
- fix(PlayCookie) PLAY_TOKEN cookie rejected because userprofile exceeds 4096 chars by @neojunjie in #5114
- feat(dashboards): add datasets field to DashboardInfo aspect by @Masterchen09 in #5188
- feat(siblings): allow viewing siblings separately by @gabe-lyons in #5390
- Added Cursor pointer to tags by @Ankit-Keshari-Vituity in #5389
- feat(GMS): Adding Dashboard Usage Models by @jjoyce0510 in #5399
- fix(quickstart): use platform agnostic way to get folder by @anshbansal in #5400
- Adds support for Domains in CSV source by @pedro93 in #5372
- feat(ingestion) Build out UI form for Snowflake Managed Ingestion by @chriscollins3456 in #5391
- Update application.yml by @liyuhui666 in #5394
- feat(model, graphql, ingest): Dashboard usage by @mayurinehate in #5397
- fix(datahub-client): Fix kafka config issue by @MugdhaHardikar-GSLab in #5403
- build: improve comprehensiveness of gradle clean by @hsheth2 in #5003
- fix(gms): Change MessageDigest to be thread safe by @pedro93 in #5405
- fix(metadata-ingestion): Fix csv enricher test by @pedro93 in #5406
- fix(tests): Removes duplicate policies tests & makes DataHub user configurable by @pedro93 in #5365
New Contributors
- @tengis made their first contribution in #5293
- @dougpm made their first contribution in #5338
- @koconder made their first contribution in #5113
- @NavinSharma13 made their first contribution in #5353
- @aezomz made their first contribution in #5255
Full Changelog: v0.8.40...v0.8.41