Changes
-
FEATURE: add support for Prometheus staleness markers. See this issue.
-
FEATURE: vmagent: automatically generate Prometheus staleness markers for the scraped metrics when scrape targets disappear in the same way as Prometheus does. See this issue.
-
FEATURE: add
present_over_time(m[d])
function, which returns 1 ifm
has a least a single sample over the previous durationd
. This function has been added also to Prometheus 2.29. -
FEATURE: vmagent: support multitenant writes according to these docs. This allows using a single
vmagent
instance in front of VictoriaMetrics cluster for all the tenants. Thanks to @omarghader for the pull request. See this issue. -
FEATURE: vmagent: add
__meta_ec2_availability_zone_id
label to discovered Amazon EC2 targets. This label is available in Prometheus starting from v2.29. -
FAETURE: vmagent: add
__meta_gce_interface_ipv4_<name>
labels to discovered GCE targets. These labels are available in Prometheus starting from v2.29. -
FEATURE: add
-search.maxSamplesPerSeries
command-line flag for limiting the number of raw samples a single query can process per each time series. This option can protect from out of memory errors when a query processes tens of millions of raw samples per series. See this issue. -
FEATURE: add
-search.maxSamplesPerQuery
command-line flag for limiting the number of raw samples a single query can process across all the time series. This option can protect from heavy queries, which select too big number of raw samples. Thanks to @jiangxinlingdu for the initial pull request. -
FEATURE: improve performance for queries that process big number of time series and/or samples on systems with big number of CPU cores.
-
FEATURE: vmalert: expose
vmalert_alerting_rules_last_evaluation_samples
andvmalert_recording_rules_last_evaluation_samples
metrics. See this issue. -
FEATURE: vminsert: expose
vm_rpc_send_duration_seconds_total
counter, which can be used for determining high saturation of everyvminsert -> vmstorage
link with an alerting queryrate(vm_rpc_send_duration_seconds_total) > 0.9s
. This query triggers when the link is saturated by more than 90%. This usually means that morevminsert
orvmstorage
nodes must be added to the cluster in order to increase the total number ofvminsert -> vmstorage
links. -
FEATURE: vmagent: expose
vmagent_remotewrite_send_duration_seconds_total
counter, which can be used for determining high saturation of every connection to remote storage with an alerting queryrate(vmagent_remotewrite_send_duration_seconds_total) > 0.9s
. This query triggers when a connection is satureated by more than 90%. This usually means that-remoteWrite.queues
command-line flag must be increased in order to increase the number of connections per each remote storage. -
FEATURE: vmui: automatically fill Server URL field. See this issue.
-
BUGFIX: fix corner cases for queries on time ranges exceeding 40 days. Previously some series can be missing in query results. See this issue.
-
BUGFIX: vmselect: return dummy response at
/rules
page in the same way as for/api/v1/rules
page. The/rules
page is requested by Grafana 8. See this issue for details. -
BUGFIX: vmbackup: automatically set default
us-east-1
S3 region if it is missing. This should simplify using S3-compatible services such as MinIO for backups. See this issue. -
BUGFIX: vmselect: prevent from possible deadlock when multiple
target
query args are passed to Graphite Render API. -
BUGFIX: return series with
a op b
labels andN
values for(a op b) default N
if(a op b)
returns series with all NaN values. Previously such series were removed. -
BUGFIX: vmui: fix layout when the query selects more than 27 time series. See this issue.
-
BUGFIX: vmagent: restore red highlighting for DOWN targets at
/targets
page. See this issue.
See full changelog.
How to run VictoriaMetrics
Unpack the victoria-metrics-*.tar.gz
archive and read these docs.
vmutils-*.tag.gz
archive contains the following tools:
vmutils-*-enterprise.tar.gz
archive contains the following additional enterprise tools:
The corresponding docker images are available here.
Cluster version is available here.