What's Changed
Fixed
- #5502 Receive: Handle exemplar storage errors as conflict error.
- #5534 Query: Set struct return by query API alerts same as prometheus API.
- #5554 Query/Receiver: Fix querying exemplars from multi-tenant receivers.
- #5583 Query: Fix data race between Respond() and query/queryRange functions. Fixes #5410.
Added
- #5440 HTTP metrics: export number of in-flight HTTP requests.
- #5424 Receive: Export metrics regarding size of remote write requests.
- #5420 Receive: Automatically remove stale tenants.
- #5472 Receive: Add new tenant metrics to example dashboard.
- #5475 Compact/Store: Added
--block-files-concurrency
allowing to configure number of go routines for downloading and uploading block files during compaction. - #5470 Receive: Expose TSDB stats as metrics for all tenants.
- #5493 Compact: Added
--compact.blocks-fetch-concurrency
allowing to configure number of goroutines for downloading blocks during compactions. - #5480 Query: Expose endpoint info timeout as a hidden flag
--endpoint.info-timeout
. - #5527 Receive: Add per request limits for remote write. Added four new hidden flags
--receive.write-request-limits.max-size-bytes
,--receive.write-request-limits.max-series
,--receive.write-request-limits.max-samples
and--receive.write-request-limits.max-concurrency
for limiting requests max body size, max amount of series, max amount of samples and max amount of concurrent requests. - #5520 Receive: Meta-monitoring based active series limiting (experimental). This mode is only available if Receiver is in Router or RouterIngestor mode, and config is provided. Added four new hidden flags
receive.tenant-limits.max-head-series
for the max active series for the tenant,receive.tenant-limits.meta-monitoring-url
for the Meta-monitoring URL,receive.tenant-limits.meta-monitoring-query
for specifying the PromQL query to execute andreceive.tenant-limits.meta-monitoring-client
for specifying HTTP client configs. - #5555 Query: Added
--query.active-query-path
flag, allowing the user to configure the directory to create an active query tracking file,queries.active
, for different resolution. - #5566 Receive: Added experimental support to enable chunk write queue via
--tsdb.write-queue-size
flag. - #5575 Receive: Add support for gRPC compression with snappy.
- #5508 Receive: Validate labels in write requests.
- #5439 Mixin: Add Alert ThanosQueryOverload to Mixin.
- #5342 Query/Query Frontend: Implement vertical sharding at query frontend for range queries.
- #5561 Query Frontend: Support instant query vertical sharding.
- #5453 Compact: Skip erroneous empty non
*AggrChunk
chunks during 1h downsampling of 5m resolution blocks.- #5607 Query: Support custom lookback delta from request in query api. - #5607 Query: Support custom lookback delta from request in query api.
Changed
- #5447 Promclient: Ignore 405 status codes for Prometheus buildVersion requests.
- #5451 Azure: Reduce memory usage by not buffering file downloads entirely in memory.
- #5484 Update Prometheus deps to v2.36.2.
- #5511 Update Prometheus deps to v2.37.0.
- #5588 Store: Improve index header reading performance by sorting values first.
- #5596 Store: Filter external labels from matchers on LabelValues/LabelNames to improve performance.
New Contributors
- @nikitapecasa made their first contribution in #5448
- @shenxn made their first contribution in #5455
- @SrushtiSapkale made their first contribution in #5447
- @chris-ng-scmp made their first contribution in #5466
- @olasd made their first contribution in #5477
- @BouchaaraAdil made their first contribution in #5465
- @eharcevs made their first contribution in #5453
- @bishal7679 made their first contribution in #5486
- @naveensrinivasan made their first contribution in #5364
- @Firxiao made their first contribution in #5496
- @Akshit42-hue made their first contribution in #5529
- @audig made their first contribution in #5534
- @Juneezee made their first contribution in #5574
- @raptorsun made their first contribution in #5439
- @oronsh made their first contribution in #5596
- @jzelinskie made their first contribution in #5611
Full Changelog: v0.27.0...v0.28.0-rc.0