redpanda-data/redpanda v23.1.8

on GitHub

Features

• Schema Registry: Support for Protobuf known types by @BenPope in #10166
• Support mTLS with customer provided client CA at Panda Proxy and Schema Registry. by @paulzhang97 in #10147

Bug Fixes

• Convert tm_snapshot to fragmented_vector to reduce memory pressure. by @BenPope in #10055
• Fix a bug in AlterConfigs which caused cleanup.policy to be un-set unless explicitly overriden. The creation time default is cleanup.policy=delete and AlterConfigs now enforces it. by @VladLazar in #10384
• Fix a bug where recovered topics would use the retention settings specified at creation time (ignoring updates after that point). by @VladLazar in #10384
• Fix offset translation errors after topic recovery by @Lazin in #10230
• #10071 Fixes violation of the atomicity of the consumer - transform - produce loop by @rystsov in #10072
• #10115 A bug is fixed where if a PUT to object storage was in flight during shutdown, Redpanda might incorrectly record a failed upload as successful. by @jcsp in #10116
• #10173 Pandaproxy will no longer assert if attempting to consume compressed message batches by @michael-redpanda in #10174
• #10173 Schema Registry will no longer assert if the _schemas topic contains compressed batches by @michael-redpanda in #10174
• #10252 A stability issue is fixed where many concurrent Produce requests using very large compressed batches could exhaust memory. by @jcsp in #10253
• #10252 A stability issue is fixed where very large ZSTD-compressed batches could exhaust memory by @jcsp in #10253
• #10273 Fixed issue with offset translation in rm_stm on snapshot hydrate by @mmaslankaprv in #10274
• #10275 Prevent allocation failures with many idempotent producers by @rockwotj in #10276
• #10331 Fixed an issue where the metric redpanda_kafka_consumer_group_consumers was reporting double the real count of consumers. by @NyaliaLui in #10332
• #10353 The consumer used in our internal kafka client will automatically find the new consumer group coordinator on not_coordinator errors. by @NyaliaLui in #10354

Improvements

• Console is automatically reconciled when the linked Redpanda cluster changes state by @nicolaferraro in #10127
• Fix reactor stalls when serializing/deserializing large snapshots. by @bharathv in #10321
• #10045 Reduced "partial message" error logging when object storage backends uncleanly terminate connections. by @jcsp in #10046
• #10290 vectorized_internal_rpc_requests_pending now has better description by @daisukebe in #10291
• #10395 Some Kafka API requests are now exempt from the node-wide throughput limiting, so that functions that are not directly related to the data path can stay responsive even in heavily throttled configurations. by @dlex in #10396
• #10410 Improved CPU balance between fetch requests and other system activity when there is a high fetch load. Previously, fetchers reading from the tip of the log could partly starve out other types of work (which produce a smaller number of tasks) causing overall poor performance, but now fetch requests have less impact on other tasks running on the CPU. by @travisdowns in #10410

Full Changelog: v23.1.7...v23.1.8