Releases: VictoriaMetrics/VictoriaMetrics
v1.110.13
v1.110.13
Released at 2025-07-04
v1.110.x is a line of LTS releases. It contains important up-to-date bugfixes for VictoriaMetrics enterprise.
All these fixes are also included in the latest community release.
The v1.110.x line will be supported for at least 12 months since v1.110.0 release
- BUGFIX: vmbackup, vmbackupmanager: automatically retry requests failing with
Expired Token
errors. This helps to avoid failed backups when using EKS Pod Identity for authentication. See #9280. - BUGFIX: vmui: fix errors in console about loading of
manifest.json
when accessing UI through vmauth with Basic Auth enabled. - BUGFIX: vmalert: fix alerts state restoration for alerting rules that are using templating in the labels. See #9305.
- BUGFIX: vmsingle and
vmstorage
in VictoriaMetrics cluster: properly return results for search requests with.+|^$
regex filter expression. See 9290 issue for details.
v1.102.25
v1.102.25
Released at 2025-07-04
v1.102.x is a line of LTS releases. It contains important up-to-date bugfixes for VictoriaMetrics enterprise.
All these fixes are also included in the latest community release.
The v1.102.x line will be supported for at least 12 months since v1.102.0 release
- BUGFIX: vmbackup, vmbackupmanager: automatically retry requests failing with
Expired Token
errors. This helps to avoid failed backups when using EKS Pod Identity for authentication. See #9280. - BUGFIX: vmalert: fix alerts state restoration for alerting rules that are using templating in the labels. See #9305.
- BUGFIX: vmsingle and
vmstorage
in VictoriaMetrics cluster: properly return results for search requests with.+|^$
regex filter expression. See 9290 issue for details.
v1.121.0
v1.121.0
Released at 2025-07-04
Update Note 1: The -retryMaxTime
flag has been deprecated. Please use -retryMaxInterval
flag instead. For more details, see #9169.
-
FEATURE: all the VictoriaMetrics Enterprise components: improve error message when an empty license is provided via the
-license
or-licenseFile
command-line flags. See #9337 for the details. -
FEATURE: vmagent: add
concurrency
option to kafka remoteWrite producer. See 9249 issue for details. -
FEATURE: vmagent and Single-node VictoriaMetrics: support
label_limit
scrape parameter. It sets labels limit for each scraped sample from a target. If limit is exceeded, the scrape will be rejected and target marked with corresponding scrape error. Thelabel_limit
can be defined on global level, per job or during relabeling via__label_limit__
label. See scrape configs doc for details. See #7660 and #3233 issues. -
FEATURE: vmagent: introduce a new flag
-retryMaxInterval
as a replacement for the deprecated-retryMaxTime
flag. The new flag more accurately reflects the behavior it controls. See #9169 for more details. Thanks to the @leiwingqueen. -
FEATURE: vmalert: add
/api/v1/notifiers
API endpoint for returning list of configured or discovered notifiers. -
FEATURE: vmalert: add
datasource_type
query argument for/api/v1/rules
and/api/v1/alerts
endpoints to filter response by rule's datasource type. See #8537. -
FEATURE: vmalert: respect group order defined in the rule file during replay mode to allow chained group if needed. See #9334.
-
FEATURE: vmalert: add
-replay.ruleEvaluationConcurrency
to allow concurrent/query_range
requests for a single rule. Increasing this value when replaying for a long time and a single request range is limited by-replay.maxDatapointsPerQuery
. See this #7387 for details. Thanks to the @BenNF. -
FEATURE: vmbackupmanager: improve error messages when
vmbackupmanager
fails to create snapshot. See #9340 for the details. -
FEATURE: vmbackupmanager: support client-side TLS configuration for creating and deleting snapshots via
-snapshot.tls*
cmd-line flags. -
FEATURE: vmsingle and vmagent: remove duplicate kubernetes targets from service-discovery-debug page. See 8626 issue for details.
-
FEATURE: vmsingle and
vmselect
in VictoriaMetrics cluster: add command-line flag-search.logSlowQueryStatsHeaders
for query execution stats. The new flag allows specifying the list of headers to log together with slow queries if user's request contains them. This flag is available only in VictoriaMetrics enterprise. See Query Stats for details. -
FEATURE: vmsingle and vmselect: add ability to proxy
/api/v1/notifiers
to vmalert when-vmalert.proxyURL
is set. See 9267 PR for details. -
FEATURE: vmsingle and
vmstorage
in VictoriaMetrics cluster: addvm_cache_eviction_bytes_total
counter metrics to reflect cache evictions due to expiration, misses and cache size. See 9293 PR for details. Thanks to the @BenNF -
FEATURE: vmsingle and
vmstorage
in VictoriaMetrics cluster: enhanceMustReadAt
panic message to include filename for easier debugging of out-of-range reads. See #9106. -
BUGFIX: dashboards/vmagent and dashboards/vmalert: fix ad-hoc filters auto-complete and filtering on panels that use MetricsQL specific expressions. See #8657.
-
BUGFIX: MetricsQL: fix negative increase result when
-search.maxLookback
or-search.maxStalenessInterval
are set and data contains gap. See #8935 (comment). -
BUGFIX: stream aggregation: properly clean quantiles output state during flush. See #9350.
-
BUGFIX: vmalert: fix exposition of duplicated metrics for dynamically discovered notifiers via Consul and DNS. See #9260.
-
BUGFIX: vmalert: remove inline styles from UI to align with
--http.header.csp=default-src 'self'
setting. See #9236. -
BUGFIX: vmalert: fix alerts state restoration for alerting rules that are using templating in the labels. See #9305.
-
BUGFIX: vmbackup, vmbackupmanager: automatically retry requests failing with
Expired Token
errors. This helps to avoid failed backups when using EKS Pod Identity for authentication. See #9280. -
BUGFIX: vmsingle and
vmstorage
in VictoriaMetrics cluster: properly return results for search requests with.+|^$
regex filter expression. See 9290 issue for details. -
BUGFIX: vmui: fix errors in console about loading of
manifest.json
when accessing UI through vmauth with Basic Auth enabled. -
BUGFIX: vmui: disabled opening of autocomplete popup on initial page load.
v1.110.12
v1.110.12
Released at 2025-06-20
v1.110.x is a line of LTS releases. It contains important up-to-date bugfixes for VictoriaMetrics enterprise.
All these fixes are also included in the latest community release.
The v1.110.x line will be supported for at least 12 months since v1.110.0 release
-
SECURITY: upgrade Go builder from Go1.24.3 to Go1.24.4. See the list of issues addressed in Go1.24.4.
-
SECURITY: upgrade base docker image (Alpine) from 3.21.3 to 3.22.0. See Alpine 3.22.0 release notes.
-
BUGFIX: vmsingle,
vminsert
in VictoriaMetrics cluster and vmagent: fixed duplication in Datadog sketches aggregation metrics. See #8836 for details. -
BUGFIX: vmsingle and
vmstorage
in VictoriaMetrics cluster: fix incorrect sorting of tag filters, which led to suboptimal tag filter evaluation order and potentially degraded query performance in rare cases. See #9127 for details. -
BUGFIX: vmselect in VictoriaMetrics cluster: expose
/-/healthy
and/-/ready
endpoints as Prometheus does on vmselect endpoints, thus achieving full Prometheus compatibility for external dependencies. -
BUGFIX: vmbackup, vmbackupmanager: fix server-side copying of objects for Azure Blob Storage when using managed identity for authentication. Previously, it wasn't possible to use smart backups strategy for
vmbackup
as server-side copy would fail. See #9131. -
BUGFIX: vmbackupmanager: increase startup healthcheck delay for storage reachability from 30 seconds to 3 minutes. This is required to avoid vmbackupmanager restarts when storage node startup take more than 30 seconds (e.g. when storage nodes stores more than 5Tb of data).
v1.102.24
v1.102.24
Released at 2025-06-20
v1.102.x is a line of LTS releases. It contains important up-to-date bugfixes for VictoriaMetrics enterprise.
All these fixes are also included in the latest community release.
The v1.102.x line will be supported for at least 12 months since v1.102.0 release
-
SECURITY: upgrade base docker image (Alpine) from 3.21.3 to 3.22.0. See Alpine 3.22.0 release notes.
-
SECURITY: upgrade Go builder from Go1.23.9 to Go1.23.10. See the list of issues addressed in Go1.23.10.
-
BUGFIX: vmsingle and
vmstorage
in VictoriaMetrics cluster: fix incorrect sorting of tag filters, which led to suboptimal tag filter evaluation order and potentially degraded query performance in rare cases. See #9127 for details. -
BUGFIX: vmselect in VictoriaMetrics cluster: expose
/-/healthy
and/-/ready
endpoints as Prometheus does on vmselect endpoints, thus achieving full Prometheus compatibility for external dependencies. -
BUGFIX: vmbackup, vmbackupmanager: fix server-side copying of objects for Azure Blob Storage when using managed identity for authentication. Previously, it wasn't possible to use smart backups strategy for
vmbackup
as server-side copy would fail. See #9131. -
BUGFIX: vmbackupmanager: increase startup healthcheck delay for storage reachability from 30 seconds to 3 minutes. This is required to avoid vmbackupmanager restarts when storage node startup take more than 30 seconds (e.g. when storage nodes stores more than 5Tb of data).
v1.120.0
v1.120.0
Released at 2025-06-20
-
SECURITY: upgrade Go builder from Go1.24.3 to Go1.24.4. See the list of issues addressed in Go1.24.4.
-
SECURITY: upgrade base docker image (Alpine) from 3.21.3 to 3.22.0. See Alpine 3.22.0 release notes.
-
FEATURE: all the VictoriaMetrics components: add
-http.disableKeepAlive
to disable HTTP keep-alives for incoming connections. The flag could improve load balancing among replicas behind HTTP load balancers. See #9125 and #2395 for details. -
FEATURE: dashboards/cluster: add panel
Partitions scheduled for re-processing
toTroubleshooting
row. It shows the amount of data scheduled for downsampling or retention filters. The new panel should help to correlate resource usage with background re-processing of partitions. -
FEATURE: MetricsQL: support rate_prometheus function, an equivalent to
increase_prometheus(series_selector[d]) / d
. See #8901 and #8891 for details. -
FEATURE: MetricsQL: respect staleness markers when calculating
rate
andincrease
functions. The new behavior will interrupt rate/increase calculation if last sample on the selected time window is a staleness marker, making the series to disappear immediately instead of slowly fading away. See more details in #8891-comment. -
FEATURE: vmalert: do not break vmalert process under replay mode when rule uses
query
template, but only logging a warning. -
FEATURE: vmalert: correct the rule evaluation timestamp if the system clock is changed during runtime. See #8790.
-
FEATURE: vmalert: respect group
concurrency
setting in replay mode when-replay.rulesDelay=0
. See this #7387 for details. Thanks to @BenNF for the PR #9214. -
FEATURE: vmsingle and
vmstorage
in VictoriaMetrics cluster: allow overriding default limits for in-memory cachestorage/metricName
via flag-storage.cacheSizeStorageMetricName
. -
BUGFIX: vmsingle and
vmstorage
in VictoriaMetrics cluster: fix incorrect sorting of tag filters, which led to suboptimal tag filter evaluation order and potentially degraded query performance in rare cases. See #9127 for details. -
BUGFIX: vmbackup, vmbackupmanager: fix server-side copying of objects for Azure Blob Storage when using managed identity for authentication. Previously, it wasn't possible to use smart backups strategy for
vmbackup
as server-side copy would fail. See #9131. -
BUGFIX: vmbackupmanager: increase startup healthcheck delay for storage reachability from 30 seconds to 3 minutes. This is required to avoid vmbackupmanager restarts when storage node startup take more than 30 seconds (e.g. when storage nodes stores more than 5Tb of data).
-
BUGFIX: VictoriaMetrics Enterprise cluster: properly include FIPS binaries in release artifacts for platforms other than windows. Previously, FIPS binaries were only included in windows release artifacts. See #9188.
-
BUGFIX: stream aggregation: properly calculate
rate_sum
andrate_avg
aggregations if aggregationinterval
is smaller than distance between samples timestamps. See #9017.
v1.24.0-victorialogs
Released at 2025-06-20
-
FEATURE: add
-http.disableKeepAlive
to disable HTTP keep-alives for incoming connections. The flag could improve load balancing among replicas behind HTTP load balancers. See #9125 and #2395 for details. -
FEATURE:
delete
pipe: allow deleting all the fields with common prefix via... | delete prefix*
syntax. -
FEATURE:
fields
pipe: allow keeping all the fields with common prefix via... | fields prefix*
syntax. -
FEATURE:
copy
pipe: allow copying all the fields with common prefix to fields with another common prefix via... | copy old_prefix* as new_prefix*
syntax. -
FEATURE:
rename
pipe: allow renaming all the fields with common prefix to fields with another common prefix via... | rename old_prefix* as new_prefix*
syntax. -
FEATURE:
unpack_json
pipe: allow unpacking JSON fields with common prefix via... fields (prefix*)
syntax. -
FEATURE:
unpack_logfmt
pipe: allow unpacking JSON fields with common prefix via... fields (prefix*)
syntax. -
FEATURE:
avg
stats function: allow calculating the average value over all the fields with common prefix viaavg(prefix*)
syntax. -
FEATURE:
max
stats function: allow calculating the maximum value over all the fields with common prefix viamax(prefix*)
syntax. -
FEATURE:
min
stats function: allow calculating the minimum value over all the fields with common prefix viamin(prefix*)
syntax. -
FEATURE:
median
stats function: allow calculating the median value over all the fields with common prefix viamedian(prefix*)
syntax. -
FEATURE:
quantile
stats function: allow calculating the maximum value over all the fields with common prefix viaquantile(prefix*)
syntax. -
FEATURE:
sum
stats function: allow calculating the sum for all the fields with common prefix viasum(prefix*)
syntax. -
FEATURE:
sum_len
stats function: allow calculating the sum of byte lengths for all the fields with common prefix viasum_len(prefix*)
syntax. -
FEATURE:
count
stats function: allow calculating the number of logs with at least a single non-empty field across fields with common prefix viacount(prefix*)
syntax. -
FEATURE:
count_empty
stats function: allow calculating the number of logs with empty fields with common prefix viacount_empty(prefix*)
syntax. -
FEATURE:
rate_sum
stats function: allow calculating the per-second rate over the sum of all the fields with common prefix viarate_sum(prefix*)
syntax. -
FEATURE:
row_any
stats function: allow returning all the fields with common prefix viarow_any(prefix*)
syntax. -
FEATURE:
row_max
stats function: allow returning all the fields with common prefix viarow_max(max_field, prefix*)
syntax. -
FEATURE:
row_min
stats function: allow returning all the fields with common prefix viarow_min(min_field, prefix*)
syntax. -
FEATURE:
uniq_values
stats function: allow fetching unique values for all the fields with common prefix viauniq_values(prefix*)
syntax. -
FEATURE:
values
stats function: allow fetching values for all the fields with common prefix viavalues(prefix*)
syntax. -
FEATURE:
json_values
stats function: allow fetching values for all the fields with common prefix viajson_values(prefix*)
syntax. -
FEATURE:
-insert.maxLineSizeBytes
: add logging of the number of bytes skipped for oversize lines. -
FEATURE: add
-insert.disable
and-select.disable
command-line flags for disabling both public and internal HTTP endpoints (/insert/*
+/internal/insert
and/select/*
+/internal/select/*
respectively). See #9061. -
FEATURE: web UI: enhance autocomplete with parsed field suggestions from unpack pipe. See this issue.
-
FEATURE: Journald data ingestion: automatically add
level
log field according to thePRIORITY
field value. This enables log level highlighting in Grafana. See #8535. -
FEATURE: Syslog data ingestion: automatically add
level
log field according to theseverity
field value. This enables log level highlighting in Grafana. -
FEATURE: Journald data ingestion: use
(_MACHINE_ID, _HOSTNAME, _SYSTEMD_UNIT)
fields as log stream fields by default. See #9143. -
FEATURE: LogsQL: optimize
(any_filter or *)
filters to*
. This avoids executing theany_filter
. Such filters are frequently generated by Grafana. -
FEATURE:
/select/logsql/query
endpoint: optimize the input query after adding thelimit
to it. This improves performance and reduces memory usage for queries ending withsort
pipe. See #9200. Thanks to @vadimalekseev for the fix. -
BUGFIX: query API: properly set storage node authorization in cluster mode when Basic Auth is enabled. See #9080.
-
BUGFIX: web UI: live tailing tab automatically reconnects when the connection is lost. See this issue.
-
BUGFIX: web UI: fix issue with hits chart ignoring selected AccountID and ProjectID. See #9157.
-
BUGFIX: web UI: fix missing field values in auto-complete. See this issue
-
BUGFIX: web UI: remove the compact mode of the table tab and add field sorting capabilities to the JSON tab. See #7047.
-
BUGFIX: Journald data ingestion: properly read log timestamp from
__REALTIME_TIMESTAMP
field according to the docs. See #9144. The bug has been introduced in v1.22.0-victorialogs. -
BUGFIX: data ingestion: support
-
as a timestamp value, as described in RFC5424. -
BUGFIX: LogsQL: properly handle quotes inside quoted strings such as
"\""
. Previously this could lead to panics. See #9219. -
BUGFIX: LogsQL regexp filter: properly parse unquoted filter ending with
*
, such asfoo:~bar.*
. It must be parsed asfoo:~"bar.*"
, while previously i...
v1.110.11
Released at 2025-06-09
v1.110.x is a line of LTS releases. It contains important up-to-date bugfixes for VictoriaMetrics enterprise.
All these fixes are also included in the latest community release.
The v1.110.x line will be supported for at least 12 months since v1.110.0 release
- BUGFIX:
vmselect
in VictoriaMetrics cluster: remove tenant labelsvm_account_id
andvm_project_id
from exported data if tenant info was specified in URL. These labels will be present only if export is done via /multitenant/ endpoint, as such response could contain series belonging to different tenants. This change also fixes inconsistency in vmctl's cluster-to-cluster migration mode - see #9016 for details. Thank @fxrlv for the bug report.
v1.110.10
v1.110.10
Released at 2025-06-06
v1.110.x is a line of LTS releases. It contains important up-to-date bugfixes for VictoriaMetrics enterprise.
All these fixes are also included in the latest community release.
The v1.110.x line will be supported for at least 12 months since v1.110.0 release
- BUGFIX: vmgateway: add missing vmselect
vmui
related routes to the authorized requests routing. See 9003 issue for details. - BUGFIX: vmsingle and
vmstorage
in VictoriaMetrics cluster: fixed a regression in downsampling logic introduced in #7440 and released in v1.106.0, where downsampling rules with filtersfilter:offset:interval
could be incorrectly skipped in favor of unfiltered rulesoffset:interval
. See #8969. - BUGFIX: vmsingle and
vmstorage
in VictoriaMetrics cluster: properly applyrententionFilter
on flag value changes. Previously, it ignored anyfilter
value changes for historical data. See this issue for details. - BUGFIX: vmsingle and
vmstorage
in VictoriaMetrics cluster: schedule a single background merge thread for merging historical data. See 4592 issue for details. - BUGFIX: vmsingle and
vmselect
in VictoriaMetrics cluster: prevent panic caused by invalid label name in metric relabeling debugging interface. Error is now properly propagated and displayed in the interface. See #8661. - BUGFIX: vmctl: enable dual-stack network mode for
vmctl
connections by default. This allows connecting to IPv6 endpoints as it was not possible previously. See #9116. - BUGFIX: vmbackup, vmrestore, vmbackupmanager: improve resilience to network issues by retrying requests failing due to
IncompleteBody
. Previously, such requests were not retried and leaded to restore/backup process failure. See this issue and this PR for details. - BUGFIX: vmselect in VictoriaMetrics cluster: include full list of query filters to build a cache key for multitenant read queries. Previously, cache key did not include tenancy related labels so cache entries could be shared between tenants breaking tenant isolation. See #9002 for details.
v1.102.23
Released at 2025-06-06
v1.102.x is a line of LTS releases. It contains important up-to-date bugfixes for VictoriaMetrics enterprise.
All these fixes are also included in the latest community release.
The v1.102.x line will be supported for at least 12 months since v1.102.0 release
- BUGFIX: vmgateway: add missing vmselect
vmui
related routes to the authorized requests routing. See 9003 issue for details. - BUGFIX: vmsingle and
vmselect
in VictoriaMetrics cluster: prevent panic caused by invalid label name in metric relabeling debugging interface. Error is now properly propagated and displayed in the interface. See #8661. - BUGFIX: vmctl: enable dual-stack network mode for
vmctl
connections by default. This allows connecting to IPv6 endpoints as it was not possible previously. See #9116. - BUGFIX: vmbackup, vmrestore, vmbackupmanager: use exponential backoff for retries when uploading or downloading data from S3. This should reduce the number of failed uploads and downloads when S3 is temporarily unavailable. See this issue.
- BUGFIX: vmbackup, vmrestore, vmbackupmanager: improve resilience to network issues by retrying requests failing due to
IncompleteBody
. Previously, such requests were not retried and leaded to restore/backup process failure. See this issue and this PR for details.