v1.116.0
Released at 2025-04-25
Update Note 1: Updated the RPC cluster protocol version for the TSDB status API, so calls to /api/v1/status/tsdb
may temporarily fail until vmstorage and vmselect are updated to the same version.
Update note 2: vmagent's data distribution algorithm of remote write is changed from round-robin to consistent hashing when -remoteWrite.shardByURL
is enabled. This means vmagents with -remoteWrite.shardByURL
will re-shard series after the upgrade, which may result into temporary higher churn rate and memory usage on remote destinations.
-
FEATURE: all the VictoriaMetrics components: mask
authKey
value from log messages. See this issue for details. -
FEATURE: dashboards/per-tenant-statistic: add panel for showing churn rate generated by each tenant on short time-window. The panel should make temporary spikes in churn more visible.
-
FEATURE: Single-node VictoriaMetrics and vmstorage: add additional metric name stats to TSDB Status API response. See this issue for details and this doc.
-
FEATURE: vmagent: dynamically upgrade to VM remote write protocol or downgrade to Prometheus protocol in runtime. This solves the problem of choosing the wrong protocol if remote destination was unavailable on vmagent start. See this issue for details.
-
FEATURE: vmagent: use consistent hashing for data distribution for remote write when
remoteWrite.shardByURL
is enabled. It helps to minimize re-sharding when removing or adding new remote write destinations. See this issue for details. -
FEATURE: vmagent: reduce log noise from remote write retries by throttling warning messages to one per 5 seconds. See this issue for details.
-
FEATURE: vmsingle and
vmselect
in VictoriaMetrics cluster: add command-line flag-search.logSlowQueryStats
. This flag is available only in VictoriaMetrics enterprise. See the following docs for details. -
FEATURE: vmsingle and
vmstorage
in VictoriaMetrics cluster: enhance/api/v1/status/metric_names_stats
withmatch_pattern
regex support. See this issue for details and related docs -
FEATURE: vmsingle, vmagent: add helpful hints to the unexpected EOF error message in the write concurrency limiter. See this pull request for details.
-
FEATURE:
vmstorage
in VictoriaMetrics cluster: log client network errors (EOFs, timeouts) during handshake as warnings, since they are not actionable from server point of view. -
FEATURE: vmui: add
Requests count
andLast request
columns to Cardinality Explorer to show metric usage. See this issue. -
FEATURE: vmui relabeling playground: enforce strict validation for
Labels
text area: it now accepts only labels enclosed in curly braces{__name__="name", label="value"}
. See related issue. -
BUGFIX: all the VictoriaMetrics components: properly detect
cgroupv2
CPU limits. See this issue for details. -
BUGFIX: vmagent: properly init enterprise version for
linux/arm
and non-CGO buids. See this issue for details. -
BUGFIX: vmagent: remote write client sets correct content encoding header based on actual body content, rather than relying on configuration. See this issue.
-
BUGFIX: vmalert: correctly update the
debug
param for recording rule when updating the rule group. -
BUGFIX: vmalert: properly set the rule group id in
/rules
and/alerts
APIs. Previously, the group id was not set, preventing rules from being toggled by group in the vmalert UI. See this issue. -
BUGFIX: vmbackup and vmbackupmanager: properly configure s3 client with if
configFilePath
is set. See this issue for details. -
BUGFIX: vmbackup, vmrestore, vmbackupmanager: enable support of HTTP/2 for connections to S3-compatible storage endpoints. It was disabled in v1.115.0 and could lead to connection errors with some S3-compatible storage providers.
-
BUGFIX: vmselect in VictoriaMetrics cluster: fix metric query stats API to correctly handle metric names longer than 256 bytes, respecting the
-maxLabelValueLen
flag. See this issue for details. -
BUGFIX: vmsingle,
vminsert
in VictoriaMetrics cluster and vmagent: supportidentity
value inContent-Encoding
HTTP header. See this issue. -
BUGFIX: vmsingle,
vminsert
in VictoriaMetrics cluster and vmagent: fix timeseries with empty timestamp and value in Datadog sketches API. See this issue. -
BUGFIX: vmsingle, vmagent,
vminsert
in VictoriaMetrics cluster: restore write concurrency limiter for data ingestion. The limiter was unintentionally removed in v1.115.0 and potentially could lead to increased memory usage in certain scenarios. See this issue. -
BUGFIX: vmsingle,
vmstorage
andvmselect
in VictoriaMetrics cluster: allow using-downsampling.period=filter:0s:0s
to skip downsampling for time series that match the specifiedfilter
. See this doc. -
BUGFIX: vmui: fix duplicated series in the legend on the Raw Query page when deduplication is disabled. See this issue.
-
BUGFIX: vmui: respect
-http.pathPrefix
flag when requesting/flags
API endpoint in vmui. See this issue for details.