opensearch-project/OpenSearch 3.2.0

on GitHub

Version 3.2.0 Release Notes

Compatible with OpenSearch and OpenSearch Dashboards version 3.2.0

Added

• [Feature Request] Enhance Terms lookup query to support query clause instead of docId (#18195)
• Add hierarchical routing processors for ingest and search pipelines (#18826)
• Add ACL-aware routing processors for ingest and search pipelines (#18834)
• Add support for Warm Indices Write Block on Flood Watermark breach (#18375)
• FS stats for warm nodes based on addressable space (#18767)
• Add support for custom index name resolver from cluster plugin (#18593)
• Rename WorkloadGroupTestUtil to WorkloadManagementTestUtil (#18709)
• Disallow resize for Warm Index, add Parameterized ITs for close in remote store (#18686)
• Ability to run Code Coverage with Gradle and produce the jacoco reports locally (#18509)
• Extend BooleanQuery must_not rewrite to numeric must, term, and terms queries (#18498)
• [Workload Management] Update logging and Javadoc, rename QueryGroup to WorkloadGroup (#18711)
• Add NodeResourceUsageStats to ClusterInfo (#18480)
• Introduce SecureHttpTransportParameters experimental API (to complement SecureTransportParameters counterpart) (#18572)
• Create equivalents of JSM's AccessController in the java agent (#18346)
• [WLM] Add WLM mode validation for workload group CRUD requests (#18652)
• Introduced a new cluster-level API to fetch remote store metadata (segments and translogs) for each shard of an index. (#18257)
• Add last index request timestamp columns to the _cat/indices API. (10766)
• Introduce a new pull-based ingestion plugin for file-based indexing (for local testing) (#18591)
• Add support for search pipeline in search and msearch template (#18564)
• [Workload Management] Modify logging message in WorkloadGroupService (#18712)
• Add BooleanQuery rewrite moving constant-scoring must clauses to filter clauses (#18510)
• Add functionality for plugins to inject QueryCollectorContext during QueryPhase (#18637)
• Add support for non-timing info in profiler (#18460)
• [Rule-based auto tagging] Bug fix and improvements (#18726)
• Extend Approximation Framework to other numeric types (#18530)
• Add Semantic Version field type mapper and extensive unit tests (#18454)
• Pass index settings to system ingest processor factories. (#18708)
• Add fetch phase profiling. (#18664)
• Include named queries from rescore contexts in matched_queries array (#18697)
• Add the configurable limit on rule cardinality (#18663)
• Disable approximation framework when dealing with multiple sorts (#18763)
• [Experimental] Start in "clusterless" mode if a clusterless ClusterPlugin is loaded (#18479)
• [Star-Tree] Add star-tree search related stats (#18707)
• Add support for plugins to profile information (#18656)
• Add support for Combined Fields query (#18724)
• Make GRPC transport extensible to allow plugins to register and expose their own GRPC services (#18516)
• Added approximation support for range queries with now in date field (#18511)
• Upgrade to protobufs 0.6.0 and clean up deprecated TermQueryProtoUtils code (#18880)
• Expand fetch phase profiling to multi-shard queries (#18887)
• Prevent shard initialization failure due to streaming consumer errors (#18877)
• APIs for stream transport and new stream-based search api action (#18722)
• Add support for custom remote store segment path prefix to support clusterless configurations (#18750)
• Added the core process for warming merged segments in remote-store enabled domains (#18683)
• Streaming aggregation (#18874)
• Optimize Composite Aggregations by removing unnecessary object allocations (#18531)
• [Star-Tree] Add search support for ip field type (#18671)
• [Derived Source] Add integration of derived source feature across various paths like get/search/recovery (#18565)
• Supporting Scripted Metric Aggregation when reducing aggregations in InternalValueCount and InternalAvg (18411))
• Support search_after numeric queries with Approximation Framework (#18896)
• Add skip_list parameter to Numeric Field Mappers (default false) (#18889)
• Optimization in Numeric Terms Aggregation query for Large Bucket Counts(#18702)
• Map to proper GRPC status codes and achieve exception handling parity with HTTP APIs(#18925)

Changed

• Update Subject interface to use CheckedRunnable (#18570)
• Update SecureAuxTransportSettingsProvider to distinguish between aux transport types (#18616)
• Make node duress values cacheable (#18649)
• Change default value of remote_data_ratio, which is used in Searchable Snapshots and Writeable Warm from 0 to 5 and min allowed value to 1 (#18767)
• Making multi rate limiters in repository dynamic #18069
• Optimize grouping for segment concurrent search by ensuring that documents within each group are as equal as possible (#18451)
• Move transport-grpc from a core plugin to a module (#18897)
• Remove experimental designation from transport-grpc settings (#18915)
• Rename package org.opensearch.plugin,transport.grpc to org.opensearch.transport.grpc (#18923)

Dependencies

• Bump stefanzweifel/git-auto-commit-action from 5 to 6 (#18524)
• Bump Apache Lucene to 10.2.2 (#18573)
• Bump org.apache.logging.log4j:log4j-core from 2.24.3 to 2.25.1 (#18589, #18744)
• Bump com.google.code.gson:gson from 2.13.0 to 2.13.1 (#18585)
• Bump com.azure:azure-core-http-netty from 1.15.11 to 1.15.12 (#18586)
• Bump com.squareup.okio:okio from 3.13.0 to 3.15.0 (#18645, #18689)
• Bump com.netflix.nebula.ospackage-base from 11.11.2 to 12.0.0 (#18646)
• Bump com.azure:azure-storage-blob from 12.30.0 to 12.30.1 (#18644)
• Bump com.google.guava:failureaccess from 1.0.1 to 1.0.2 (#18672)
• Bump io.perfmark:perfmark-api from 0.26.0 to 0.27.0 (#18672)
• Bump org.bouncycastle:bctls-fips from 2.0.19 to 2.0.20 (#18668)
• Bump org.bouncycastle:bcpkix-fips from 2.0.7 to 2.0.8 (#18668)
• Bump org.bouncycastle:bcpg-fips from 2.0.10 to 2.0.11 (#18668)
• Bump com.password4j:password4j from 1.8.2 to 1.8.3 (#18668)
• Bump com.azure:azure-core from 1.55.3 to 1.55.5 (#18691)
• Bump com.squareup.okhttp3:okhttp from 4.12.0 to 5.1.0 (#18749)
• Bump com.google.jimfs:jimfs from 1.3.0 to 1.3.1 (#18743), #18746), #18748)
• Bump com.azure:azure-storage-common from 12.29.0 to 12.29.1 (#18742)
• Bump org.apache.commons:commons-lang3 from 3.17.0 to 3.18.0 (#18745), (#18955)
• Bump com.nimbusds:nimbus-jose-jwt from 10.2 to 10.4 (#18759, #18804)
• Bump commons-beanutils:commons-beanutils from 1.9.4 to 1.11.0 (#18401)
• Bump org.xerial.snappy:snappy-java from 1.1.10.7 to 1.1.10.8 (#18803)
• Bump org.ajoberstar.grgit:grgit-core from 5.2.1 to 5.3.2 (#18935)
• Bump org.apache.kafka:kafka-clients from 3.8.1 to 3.9.1 (#18935)

Fixed

• Add task cancellation checks in aggregators (#18426)
• Fix concurrent timings in profiler (#18540)
• Fix regex query from query string query to work with field alias (#18215)
• [Autotagging] Fix delete rule event consumption in InMemoryRuleProcessingService (#18628)
• Cannot communicate with HTTP/2 when reactor-netty is enabled (#18599)
• Fix the visit of sub queries for HasParentQuery and HasChildQuery (#18621)
• Fix the backward compatibility regression with COMPLEMENT for Regexp queries introduced in OpenSearch 3.0 (#18640)
• Fix Replication lag computation (#18602)
• Fix max_score is null when sorting on score firstly (#18715)
• Field-level ignore_malformed should override index-level setting (#18706)
• Fixed Staggered merge - load average replace with AverageTrackers, some Default thresholds modified (#18666)
• Use new SecureRandom() to avoid blocking (18729)
• Ignore archived settings on update (#8714)
• Ignore awareness attributes when a custom preference string is included with a search request (#18848)
• Use ScoreDoc instead of FieldDoc when creating TopScoreDocCollectorManager to avoid unnecessary conversion (#18802)
• Fix leafSorter optimization for ReadOnlyEngine and NRTReplicationEngine (#18639)
• Close IndexFieldDataService asynchronously (#18888)
• Fix query string regex queries incorrectly swallowing TooComplexToDeterminizeException (#18883)
• Fix socks5 user password settings for Azure repo (#18904)
• Reset isPipelineResolved to false to resolve the system ingest pipeline again. (#18911)
• Bug fix for scaled_float in encodePoint method (#18952)