What’s New in Release 0.13.2
Improved SQL Lineage
- We have collaborated with the sqllineage and sqlfluff communities to improve the parsing capabilities of sqllineage. We'll continue to collaborate to ship further improvements in new releases.
New Glossary UI
- Moved from a tree view in the left panel to an easy-to-navigate list of the terms sorted alphabetically.
- The term list shows the tags and descriptions in the cards.
Glossary Import & Export
- You can now export your Glossary data as a CSV file.
- In the same way, you can now bulk upload terms to a Glossary by adding their details in a CSV file.
- The import utility will validate the file and show you a preview of the elements that are going to be imported to OpenMetadata.
Unified Tag Category API
- Renamed Tag Categories to Classification, a more widely used term.
- Updated the API to conform with the rest of the specifications. More info here.
Mutually Exclusive Tags
- When creating a Classification or a Glossary term, you can now make the tags mutually exclusive.
- If tags are set to be mutually exclusive, you won't be able to set multiple tags from the same category in the same asset.
EntityName
- To better manage and harmonize entityName value and allow users to form better expectations around these values, the team introduced enforcement of the entityName format using a regex pattern. You can find more information about this in the docs.
Ingestion Framework
- Performance Improvements: We are now getting descriptions in batch, making connectors such as Redshift or Snowflake way faster!
- The Oracle connector now ships with the Thick mode enabled.
- AWS QuickSight...
What's Changed
- Added dbt workflow docs by @OnkarVO7 in #9493
- fix: Docker CI Workflow for publishing OpenMetadata Server Binaries and Images by @akash-jain-10 in #9498
- fix redirection issue from entity details page to profiler page by @ShaileshParmar11 in #9494
- Removing ES volumes by @pmbrull in #9503
- fix: docs-k8s by @akash-jain-10 in #9505
- chore(ui): eliminate unused packages and code by @chirag-madlani in #9501
- fix : e2e teams spec by @Sachin-chaurasiya in #9492
- Cypress: Fixed data quality and profiler cypress test by @ShaileshParmar11 in #9461
- fix(ui): missing localization for activity feed alert by @chirag-madlani in #9514
- chore : remove unused request description modal by @Sachin-chaurasiya in #9515
- Organise dynamic importers by @pmbrull in #9513
- Fixes #9510 Enable authorization tests for all the entities by @sureshms in #9511
- Fix#9448: Add ES volumes by @nahuelverdugo in #9506
- fix(ui): license header added for missing files by @chirag-madlani in #9522
- Fixes #9259 Change Tags APIs to conform with rest of the APIs by @sureshms in #9260
- fix(ui): automate license header process via pre-commit hook by @chirag-madlani in #9523
- Fix Elasticsearch reindex through CLI by @ulixius9 in #9528
- Fix #6562 - Sources have their own package by @pmbrull in #9521
- prepare(release) next release by @chirag-madlani in #9479
- update docs for 0.13.1 as stable release by @chirag-madlani in #9531
- Fix bigquery migration and deprecate sample data type by @pmbrull in #9533
- Revert Change by @ayush-shah in #9534
- UI : Remove tailwind css dependency from Roles and Basic signup form by @Ashish8689 in #9517
- chore(ui): clean localisation keys by @chirag-madlani in #9529
- UI : UI improvement for Policy, Roles and Test Suite by @Ashish8689 in #9500
- fix(test): cypress fix for dynamic url instead static by @chirag-madlani in #9541
- fix import missing for base url by @chirag-madlani in #9543
- bum(ui): eslint v8 by @chirag-madlani in #9526
- Fixes #9118 - Glossary bulk upload support by @sureshms in #9524
- Latest tag release by @dhruvinmaniar123 in #9516
- test(ui): cypress added for alerts flow by @chirag-madlani in #9527
- UI : Remove tailwind css dependency from Policies and Rule Page by @Ashish8689 in #9518
- fix(ui): tag api related changes to UI by @chirag-madlani in #9532
- Upgrade library dependencies by @sureshms in #9547
- Fixed ingestion tags with new tags API by @OnkarVO7 in #9552
- Fixed bigquery e2e test by @OnkarVO7 in #9555
- Fix Flyway Clean Disabled Issue by @mohityadav766 in #9556
- Fix #8088 - Restructure source connections & clients by @pmbrull in #9545
- fixed tags and classifications update issue by @ShaileshParmar11 in #9563
- Fix: refactor get_column_type by @NiharDoshi99 in #9559
- Added maven publish git action workflow by @parthp2107 in #9568
- chore(ui): remove react-select deps from project by @chirag-madlani in #9570
- Improve SQL column lineage parsing by @martsec in #9537
- Added run conditions for mvn publish workflow by @parthp2107 in #9571
- Redshift: varchar datatype fix by @ulixius9 in #9572
- chore(ui): improve localisation keys by @chirag-madlani in #9569
- feat(ui): support locale change option from UI by @chirag-madlani in #9553
- fixed glossary term and user profile picture API failure issue by @ShaileshParmar11 in #9581
- Fix UI issue due to dropwizard Upgrade by @mohityadav766 in #9590
- bump node version to align with UI by @chirag-madlani in #9591
- Enabled Alert Tests by @mohityadav766 in #9463
- Fix #9149 - Postgres foreign tables & reorganize queries for sources by @pmbrull in #9588
- Fix #8422: Fix False usage query count by @ulixius9 in #9587
- fix(ui): cypress test fixes and improvements by @aniketkatkar97 in #9574
- fix(test): cypress failure for react-select changes by @chirag-madlani in #9596
- refactor : move ErrorBoundary, Authentication and Router folder to components folder by @Sachin-chaurasiya in #9592
- chore(ui): fix todo comments and done cleanup on types by @chirag-madlani in #9585
- chore(ui): remove react-slick and use AntD carousel by @chirag-madlani in #9586
- Bump fast-json-patch from 3.0.0-1 to 3.1.1 in /openmetadata-ui/src/main/resources/ui by @dependabot in #9551
- add devops team review for workflow updates by @chirag-madlani in #9603
- chore(ui): jest comment for coverage on PRs by @chirag-madlani in #9601
- chore(ui) : Remove react-tippy dependency and use antd component by @Sachin-chaurasiya in #9606
- remove hide comment from jest-coverage-comment by @chirag-madlani in #9610
- Fix: Table description error for table by @MilanBariya in #9584
- Fix: refractor datalake datatypes and s3 for parquet by @NiharDoshi99 in #9578
- Bump json5 from 2.2.1 to 2.2.3 in /openmetadata-ui/src/main/resources/ui by @dependabot in #9608
- fix(ui): split of undefined error by @chirag-madlani in #9609
- fix(ui): missing localization key for delete widget by @chirag-madlani in #9600
- fixed ANTD deprecated warnings by @ShaileshParmar11 in #9560
- Fixes#9576: Data insights page empty and reindexing fails by @parthp2107 in #9597
- Fix #9562: Add duration in usage ingestion by @ulixius9 in #9564
- Fix security vulnerability by @ayush-shah in #9580
- chore : Update localization values by @Sachin-chaurasiya in #9598
- Issue 5592: Add Databricks Pipeline Connector by @sjrusso8 in #9554
- Fix: AttributeError when node is not in catalog by @MilanBariya in #9622
- Fix Tag Missing Relation by @mohityadav766 in #9616
- Fix #6829: Improve usage filtering by @ulixius9 in #9613
- Fix User entity pagination when isBot flag is False for Postgres by @mosiac1 in #9604
- ui: localization changes by @ShaileshParmar11 in #9612
- Fix table comment not being ingested by @ulixius9 in #9627
- Code cleanup to fix IDE flagged warnings by @sureshms in #9614
- chore (ui) : add coverage path ignore patterns by @Sachin-chaurasiya in #9628
- Fix 7972: Added dbt tag classification name by @OnkarVO7 in #9575
- chore (ui) : remove react-tippy and rc-tree from webpack config by @Sachin-chaurasiya in #9631
- test case for DomoDatabase by @NiharDoshi99 in #9630
- chore(ui): clean up the type declaration file by @Sachin-chaurasiya in #9624
- fix: Docs for AWS EKS Helm Deployment by @akash-jain-10 in #9615
- chore(ui): organise import paths with meaningful names by @chirag-madlani in #9633
- Fix #9286 & #9306 - Fix Session handling for scheduler job by @pmbrull in #9636
- Fixed#9426: When in Debug mode OM is logging passwords in plaintext by @parthp2107 in #9629
- Modify env to be same for testing by @ayush-shah in #9539
- Minor: Delete generated directory to delete older files by @harshach in #9643
- fix: GH Actions use mishakav github actions step with the new changes merged by @akash-jain-10 in #9646
- Fix #8866 - bump datamodel-codegen by @pmbrull in #9623
- Updated Description in case of column updates by @mohityadav766 in #9635
- chore(deps): bump luxon from 3.1.0 to 3.2.1 in /openmetadata-ui/src/main/resources/ui by @dependabot in #9659
- cypress: added test cases for advance search by @ShaileshParmar11 in #9617
- Docs fix, set intelli jidea env by @mark800 in #9641
- Fix #9158: OpenSearch/ElasticSearch - Language based mappings by @harshach in #9163
- refactor : Add useAirflowStatus hook by @Sachin-chaurasiya in #9473
- UI: Added localization changes part 2 by @ShaileshParmar11 in #9658
- Alert Test Fix by @mohityadav766 in #9640
- chore(ui) : Add skeleton loading for page and components by @Sachin-chaurasiya in #9619
- fix(ui): activity feed filter bug on homepage by @aniketkatkar97 in #9653
- fix(ui): sonar-cloud code-smells and code optimizations by @chirag-madlani in #9634
- chore(ui) : Organize imports from baseURL with tsconfig-paths-webpack-plugin by @Sachin-chaurasiya in #9663
- Fixed#9651: DQ for datalake not showing on UI by @parthp2107 in #9668
- UI: Added localization part 3 by @ShaileshParmar11 in #9669
- Add Doc for Data Catalog api permission by @ayush-shah in #9676
- Fix #7768 - Update and organize versions by @pmbrull in #9664
- UI : Fix ML_Model issues and added version feature in it by @Ashish8689 in #9672
- [WIP] - Add Scarf gateway by @pmbrull in #9652
- Fixed: Enabled skipped unit test and deprecated svgUtils.tsx by @ShaileshParmar11 in #9684
- Fix: neo4j version bump by @NiharDoshi99 in #9680
- Fixed DB2 Profiler by @OnkarVO7 in #9679
- Fixes #9656 -- Add support for datetime type for col between by @TeddyCr in #9671
- fixes #9673 - Oracle casting error by @TeddyCr in #9682
- Fix Topic index to map properly by @mohityadav766 in #9688
- Fix #7156: Add Sample Data for Kafka and Redpanda by @ulixius9 in #9472
- Add: Function for Postgres Tags by @MilanBariya in #9683
- chore(ui): update localisation for constants by @chirag-madlani in #9670
- UI: Improved summary panel by @aniketkatkar97 in #9470
- e2e: UI : User journey for permission end-2-end test by @Sachin-chaurasiya in #9667
- test(ui): clean alerts that cypress created for tests by @chirag-madlani in #9697
- Code cleanup of IDE flagged issues by @sureshms in #9715
- fix(ui): remove redundant tags from explore page by @chirag-madlani in #9701
- Fixed UI: Add owner for glossary is not showing option on initial open #9602 by @ShaileshParmar11 in #9700
- Fix #9153 - Postgres case sensitive column name by @TeddyCr in #9705
- Docs - librdkafka installation by @pmbrull in #9703
- Extra headers for metadata API by @czuares in #9321
- updated rule evealutor tests by @mohityadav766 in #9711
- Updated to Expire After Write by @mohityadav766 in #9712
- fix(#9720) : Profiler Partion Configuration is not sent in the API request by @Sachin-chaurasiya in #9723
- Fix: added test case for atlas by @NiharDoshi99 in #9678
- remove computePercentile from table usage summary by @mohityadav766 in #9681
- Fixes #9721 Add support for count of terms in Glossary and Classifica… by @sureshms in #9733
- Fixes Incorrect Classification of Tier Tags for tags containing word … by @mohityadav766 in #9732
- fixes #9718 -- Add DQ partition support + improve logic by @TeddyCr in #9731
- chore(ui): support lint & prettier for cypress files by @chirag-madlani in #9728
- Fix Typo and link issues by @ayush-shah in #9737
- Cypress: Fixed failing cypress test in main and glossary search localization by @ShaileshParmar11 in #9730
- UI : Added Classification Field in DBT by @Ashish8689 in #9727
- Profile sample rows + Randomization of chunks for datalake by @ayush-shah in #9595
- UI : Fix the non-selected card color while search in Explore page by @Ashish8689 in #9747
- UI : Fix the Classifications Count issue by @Ashish8689 in #9744
- UI : Added default value for DBT Classification field by @Ashish8689 in #9763
- UI : Fix the count in Data Insights page on Tier by @Ashish8689 in #9748
- feat ✨ : Add support for glossary bulk upload and download. by @Sachin-chaurasiya in #9726
- Fix: Domo dashboard issue by @NiharDoshi99 in #9743
- Fixes #9618 Allow apostrophe in entity names by @sureshms in #9642
- Keep elasticsearch version to be 7.13.1 by @harshach in #9756
- ui: loaders added in missing places. by @aniketkatkar97 in #9764
- fix(ui): search dropdown options case changing issue by @aniketkatkar97 in #9745
- UI : Added Flag to exclude bot from user search by @Ashish8689 in #9766
- fix(ui): disabled profiler calls for deleted tables for summary panel details by @aniketkatkar97 in #9771
- Fix #9558 - Add a greater range for boto3 dependency by @pmbrull in #9778
- Fix #9752: docker openmetadata_ingestion should only depend on db by @harshach in #9753
- databricks-test-added by @codingwithabhi in #9749
- UI : Added mutual exclusive fields in glosaary and classification by @Ashish8689 in #9741
- UI: Glossary ui revamp by @ShaileshParmar11 in #9729
- Fix #9777 - Pass XLets as input parameters for lineage runner by @pmbrull in #9780
- Revert "UI : Added Flag to exclude bot from user search (#9766)" by @Ashish8689 in #9787
- Powerbi pagination fix by @OnkarVO7 in #9784
- UI : UI improvements by @Ashish8689 in #9779
- Issue 9542 - Replace the default name for MySQL db by @codingwithabhi in #9687
- Dbt e2e test by @OnkarVO7 in #9767
- Deprecate OMetaDatabaseAndTable by @MilanBariya in #9760
- fix(#9775): UI - Teams owner can only be another user not another team by @Sachin-chaurasiya in #9789
- Fixed Table isn't found to be added in the lineage #9746 by @ShaileshParmar11 in #9782
- Fixed UI: While removing one edge, all the edge related to same node is getting disappear #9792 by @ShaileshParmar11 in #9793
- Fix: atlas test connection by @NiharDoshi99 in #9791
- Fix: Quicksight Dashboard and chart Metadata Ingestion by @ayush-shah in #9786
- Fix #9695: Teams show up in lower case by @harshach in #9757
- Fix #8884 & #9460 - View lineage happens in the lineage workflow by @pmbrull in #9796
- Updated test yml file for dbt e2e by @OnkarVO7 in #9795
- UI: Unit tests added for PR 9764 by @aniketkatkar97 in #9790
- Fix #6577: Optimize metadata reads by @ulixius9 in #9759
- Fix #9707 - Install instantclient and enable thick mode by @pmbrull in #9761
- Cy: skip the teams spec test and removed * from search API call by @ShaileshParmar11 in #9803
- Modify Slack Env by @ayush-shah in #9806
- UI : Added more spacing and wrap the text in the cell by @Ashish8689 in #9807
- Fix/docs-misc by @akash-jain-10 in #9666
- [Cherry Pick to 0.13.2] fix: max value for column between (#9820) by @TeddyCr in #9841
- Quicksight charts by @ayush-shah in #9837
- Vertica comments, dbs, profiler and docs (#9845) by @pmbrull in #9857
- Cherry picked profiler partition to 0.13.2 by @TeddyCr in #9869
- Cherry Pick: Update airflow loggers and rename ometa loggers (#9868) by @pmbrull in #9871
- Fix Mapper Parser issue - 0.13.2 by @ayush-shah in #9867
- 0.13.2-beta release version bump by @pmbrull in #9872
- Added databricks in lineage model (#9887) by @MilanBariya in #9916
- Update: Trino, Presto Logic and Doc (#9859) by @MilanBariya in #9926
- 0.13.2 - Update WebAnalytic Prometheus Metric by @TeddyCr in #9966
- Fix Glue Client by @ayush-shah in #9992
- fix(ui): JwtClaim should also check for "sub" claim and add fallback by @Sachin-chaurasiya in #9909
- 0.13.2 release version bump by @aniketkatkar97 in #9967
New Contributors
- @martsec made their first contribution in #9537
- @sjrusso8 made their first contribution in #9554
- @czuares made their first contribution in #9321
Full Changelog: 0.13.1-release...0.13.2-release