hashicorp/vault v1.16.0-rc1 on GitHub

1.16.0-rc1

February 14, 2024

SECURITY:

secrets/transit: fix a regression that was honoring nonces provided in non-convergent modes during encryption. [GH-22852]

CHANGES:

Upgrade grpc to v1.58.3 [GH-23703]
Upgrade x/net to v0.17.0 [GH-23703]
api: add the enterprise parameter to the /sys/health endpoint [GH-24270]
auth/alicloud: Update plugin to v0.17.0 [GH-25217]
auth/approle: Normalized error response messages when invalid credentials are provided [GH-23786]
auth/azure: Update plugin to v0.17.0 [GH-25258]
auth/cf: Update plugin to v0.16.0 [GH-25196]
auth/gcp: Update plugin to v0.16.2 [GH-25233]
auth/jwt: Update plugin to v0.20.0 [GH-25326]
auth/kerberos: Update plugin to v0.11.0 [GH-25232]
auth/kubernetes: Update plugin to v0.18.0 [GH-25207]
auth/oci: Update plugin to v0.15.1 [GH-25245]
cli: Using vault plugin reload with -plugin in the root namespace will now reload the plugin across all namespaces instead of just the root namespace. [GH-24878]
cli: vault plugin info and vault plugin deregister now require 2 positional arguments instead of accepting either 1 or 2. [GH-24250]
core: Bump Go version to 1.21.5.
database/couchbase: Update plugin to v0.10.1 [GH-25275]
database/elasticsearch: Update plugin to v0.14.0 [GH-25263]
database/mongodbatlas: Update plugin to v0.11.0 [GH-25264]
database/redis-elasticache: Update plugin to v0.3.0 [GH-25296]
database/redis: Update plugin to v0.2.3 [GH-25289]
database/snowflake: Update plugin to v0.10.0 [GH-25143]
events: Source URL is now vault://{vault node} [GH-24201]
identity (enterprise): POST requests to the /identity/entity/merge endpoint
are now always forwarded from standbys to the active node. [GH-24325]
plugins/database: Reading connection config at database/config/:name will now return a computed running_plugin_version field if a non-builtin version is running. [GH-25105]
plugins: Add a warning to the response from sys/plugins/reload/backend if no plugins were reloaded. [GH-24512]
plugins: By default, environment variables provided during plugin registration will now take precedence over system environment variables.
Use the environment variable VAULT_PLUGIN_USE_LEGACY_ENV_LAYERING=true to opt out and keep higher preference for system environment
variables. When this flag is set, Vault will check during unseal for conflicts and print warnings for any plugins with environment
variables that conflict with system environment variables. [GH-25128]
plugins: /sys/plugins/runtimes/catalog response will always include a list of "runtimes" in the response, even if empty. [GH-24864]
sdk: Upgrade dependent packages by sdk.
This includes github.com/docker/docker to v24.0.7+incompatible,
google.golang.org/grpc to v1.57.2 and golang.org/x/net to v0.17.0. [GH-23913]
secrets/ad: Update plugin to v0.17.0 [GH-25187]
secrets/alicloud: Update plugin to v0.16.0 [GH-25257]
secrets/azure: Update plugin to v0.17.0 [GH-25189]
secrets/gcp: Update plugin to v0.18.0 [GH-25173]
secrets/gcpkms: Update plugin to v0.16.0 [GH-25231]
secrets/keymgmt: Update plugin to v0.10.0
secrets/kubernetes: Update plugin to v0.7.0 [GH-25204]
secrets/kv: Update plugin to v0.17.0 [GH-25277]
secrets/mongodbatlas: Update plugin to v0.11.0 [GH-25253]
secrets/openldap: Update plugin to v0.12.0 [GH-25251]
secrets/terraform: Update plugin to v0.7.5 [GH-25288]
telemetry: Seal wrap encrypt/decrypt metrics now differentiate between seals using a metrics label of seal name rather than separate metric names. [GH-23837]
ui: Update icons to use Flight icons where available. [GH-24823]
ui: add subnav for replication items [GH-24283]

FEATURES:

Audit Filtering: Audit devices support expression-based filter rules (powered by go-bexpr) to determine which entries are written to the audit log. [GH-24558]
Custom messages: Introduces custom messages settings, allowing users to view, and operators to configure system-wide messages. [GH-23945]
Database Event Notifications: The database plugin now emits event notifications. [GH-24718]
Default Lease Count Quota: Apply a new global default lease count quota of 300k leases for all
new installs of Vault. [GH-24382]
Manual License Utilization Reporting: Added manual license
utilization reporting, which allows users to create manual exports of product-license [metering
data] to report to Hashicorp.
Plugin Identity Tokens: Adds secret-less configuration of AWS secret engine using web identity federation. [GH-24987]
Plugin Workload Identity: Vault can generate identity tokens for plugins to use in workload identity federation auth flows. [GH-25219]
Quotas in Privileged Namespaces: Enable creation/update/deletion of quotas from the privileged namespace [GH-24040]
Reload seal configuration on SIGHUP: Seal configuration is reloaded on SIGHUP so that seal configuration can
be changed without shutting down vault [GH-23571]
Request Limiter: Add adaptive concurrency limits to write-based HTTP
methods and special-case pki/issue requests to prevent overloading the Vault
server. [GH-25093]
Rotate Root for LDAP auth: Rotate root operations are now supported for the LDAP auth engine. [GH-24099]
Seal High Availability (enterprise): Operators can configure more than one automatic seal for resilience against seal provider outages.
Secrets Sync UI (enterprise): Adds secret syncing for KV v2 secrets to external destinations using the UI. [GH-23667]
Vault PKI EST Server (Enterprise/Beta): Beta support for the PKI Enrollment over Secure Transport (EST) certificate management protocol has been added to the Vault PKI Plugin. This allows standard EST clients to request certificates from a Vault server with no knowledge of Vault APIs.
Vault Proxy Static Secret Caching: Adds support for static secret (KVv1 and KVv2) caching to Vault Proxy. [GH-23621]
raft-wal: Add experimental support for raft-wal, a new backend engine for integrated storage. [GH-21460]
secrets-import (enterprise): Support importing secrets from external sources into KVv2
secrets/aws: Support issuing an STS Session Token directly from the root credential. [GH-23690]
cli/snapshot: Add CLI tool to inspect Vault snapshots [GH-23457]
cli: introduce new command group hcp which groups subcommands for authentication of users or machines to HCP using
either provided arguments or retrieved HCP token through browser login. [GH-23897]
config/listener: allow per-listener configuration setting to disable replication status endpoints. [GH-23547]
config/listener: allow per-listener configuration settings to redact sensitive parts of response to unauthenticated endpoints. [GH-23534]
core: add sys/internal/ui/version endpoint [GH-23740]
sys (enterprise): Enable sys/config/group-application-policy in privileged namespace

IMPROVEMENTS:

.release/linux: add LimitCORE=0 to vault.service [GH-23272]
agent/template: Added max_connections_per_host to limit total number of connections per Vault host. [GH-24548]
agent: Added new namespace top level configuration parameter, which can be used to make requests made by Agent to go to that namespace. [GH-24667]
agent: allow users to specify files for child process stdout/stderr [GH-22812]
api (enterprise): Enable the sys/license/features from any namespace
api/plugins: add tls-server-name arg for plugin registration [GH-23549]
api: added new API field to Vault responses, mount_type, returning mount information (e.g. kv for KVV1/KVV2) for mount when appropriate. [GH-23047]
api: sys/health and sys/ha-status now expose information about how long
the last heartbeat took, and the estimated clock skew between standby and
active node based on that heartbeat duration. [GH-24343]
auth/ldap: introduce cap/ldap.Client for LDAP authentication
auth/ldap: deprecates connection_timeout in favor of request_timeout for timeouts
sdk/ldaputil: deprecates Client in favor of cap/ldap.Client [GH-22185]
auth/saml: Update plugin to v0.2.0
auto-auth/azure: Support setting the authenticate_from_environment variable to "true" and "false" string literals, too. [GH-22996]
cli: Improved error messages for vault plugin sub-commands. [GH-24250]
cli: adds plugin identity token to enable and tune commands for secret engines and auth methods [GH-24980]
command/server: display logs on startup immediately if disable-gated-logs flag is set [GH-24280]
command/token-capabilities: allow using accessor when listing token capabilities on a path [GH-24479]
core (enterprise): Avoid seal rewrapping in some specific unnecessary cases.
core (enterprise): Improve seal unwrap performance when in degraded mode with one or more unhealthy seals. [GH-25171]
core (enterprise): Speed up unseal when using namespaces
core/activity: Include secret_syncs in activity log responses [GH-24710]
core/cli: Warning related to VAULT_ADDR & -address not set with CLI requests. [GH-17076]
core: Added new plugin_tmpdir config option for containerized plugins, in addition to the existing VAULT_PLUGIN_TMPDIR environment variable. [GH-24978]
core: update sys/seal-status (and CLI vault status) to report the type of
the seal when unsealed, as well as the type of the recovery seal if an
auto-seal. [GH-23022]
events: Add support for event subscription plugins, including SQS [GH-24352]
identity/tokens: adds plugin issuer with openid-configuration and keys APIs [GH-24898]
limits: Add a listener configuration option disable_request_limiter to allow
disabling the request limiter per-listener. [GH-25098]
limits: Introduce a reloadable disable configuration for the Request Limiter. [GH-25095]
oidc/provider: Adds code_challenge_methods_supported to OpenID Connect Metadata [GH-24979]
plugins: Add new pin version APIs to enforce all plugins of a specific type and name to run the same version. [GH-25105]
plugins: Containerized plugins can be run fully rootless with the runsc runtime. [GH-24236]
plugins: New API sys/plugins/reload/:type/:name available in the root namespace for reloading a specific plugin across all namespaces. [GH-24878]
proxy: Added new namespace top level configuration parameter, and prepend_configured_namespace API Proxy configuration parameter, which can be used to make requests made to Proxy get proxied to that namespace. [GH-24667]
replication (enterprise): Add last_upstream_remote_wal metric to telemetry and stop emitting last_remote_wal on standby nodes
replication (enterprise): Add re-index status metric to telemetry
replication: Add re-index status metric to telemetry [GH-23160]
sdk/plugin: Fix an issue where external plugins were not reporting logs below INFO level [GH-23771]
sdk: Add identity token helpers to consistently apply new plugin WIF fields across integrations. [GH-24925]
sdk: adds new method to system view to allow plugins to request identity tokens [GH-24929]
secrets-sync (enterprise): Add ability to turn the sync system on and off
secrets-sync (enterprise): Add reconciliation loop
secrets-sync (enterprise): Added PATCH request on the sync destinations API
secrets-sync (enterprise): Added delete request to reset global config to factory defaults
secrets-sync (enterprise): Added field to define custom tags to add on synced secrets
secrets-sync (enterprise): Added telemetry on number of destinations and associations per type.
secrets-sync (enterprise): Adds ability to set target GCP project ID to sync secrets with
secrets-sync (enterprise): Adjusted associations list responses to be more CLI-friendly
secrets-sync (enterprise): Adjusted destination list responses to be more CLI-friendly & added endpoint to list destinations by type.
secrets-sync (enterprise): Clean up membdb tests
secrets-sync (enterprise): Support AWS IAM assume role and external ID
secrets-sync (enterprise): Support custom GitHub apps
secrets-sync (enterprise): Support custom templating of external secret names
secrets-sync (enterprise): Support granular secrets syncing
secrets-sync (enterprise): add purge field to the destination delete endpoint
secrets/database: Add new reload/:plugin_name API to reload database plugins by name for a specific mount. [GH-24472]
secrets/database: Support reloading named database plugins using the sys/plugins/reload/backend API endpoint. [GH-24512]
secrets/pki: do not check TLS validity on ACME requests redirected to https [GH-22521]
storage/etcd: etcd should only return keys when calling List() [GH-23872]
storage/raft (enterprise): Replication WAL batches may now contain up to 4096
entries rather than being limited to 62 like Consul is. Performance testing
shows improvements in throughput and latency under some write-heavy workloads.
storage/raft: Add support for larger transactions when using raft storage. [GH-24991]
storage/raft: Upgrade to bbolt 1.3.8, along with an extra patch to reduce time scanning large freelist maps. [GH-24010]
sys (enterprise): Adds the chroot_namespace field to this sys/internal/ui/resultant-acl endpoint, which exposes the value of the chroot namespace from the
listener config.
sys: adds configuration of the key used to sign plugin identity tokens during mount enable and tune [GH-24962]
ui: Add warning message to the namespace picker warning users about the behavior when logging in with a root token. [GH-23277]
ui: Adds a warning when whitespace is detected in a key of a KV secret [GH-23702]
ui: Adds toggle to KV secrets engine value download modal to optionally stringify value in downloaded file [GH-23747]
ui: Allow users in userpass auth mount to update their own password [GH-23797]
ui: Implement Helios Design System Breadcrumbs [GH-24387]
ui: Implement Helios Design System copy button component making copy buttons accessible [GH-22333]
ui: Implement Helios Design System footer component [GH-24191]
ui: Implement Helios Design System pagination component [GH-23169]
ui: Increase base font-size from 14px to 16px and update use of rem vs pixels for size variables [GH-23994]
ui: Makes modals accessible by implementing Helios Design System modal component [GH-23382]
ui: Replace inline confirm alert inside a popup-menu dropdown with confirm alert modal [GH-21520]
ui: Separates out client counts dashboard to overview and entity/non-entity tabs [GH-24752]
ui: Sort list view of entities and aliases alphabetically using the item name [GH-24103]
ui: Surface warning banner if UI has stopped auto-refreshing token [GH-23143]
ui: Update AlertInline component to use Helios Design System Alert component [GH-24299]
ui: Update flat, shell-quote and swagger-ui-dist packages. Remove swagger-ui styling overrides. [GH-23700]
ui: Update mount backend form to use selectable cards [GH-14998]
ui: Update sidebar Secrets engine to title case. [GH-23964]
ui: Use Hds::Dropdown component to replace list view popup menus [GH-25321]
ui: capabilities-self is always called in the user's root namespace [GH-24168]
ui: improve accessibility - color contrast, labels, and automatic testing [GH-24476]
ui: latest version of chrome does not automatically redirect back to the app after authentication unless triggered by the user, hence added a link to redirect back to the app. [GH-18513]
ui: obscure JSON values when KV v2 secret has nested objects [GH-24530]
ui: redirect back to current route after reauthentication when token expires [GH-25335]
ui: remove unnecessary OpenAPI calls for unmanaged auth methods [GH-25364]
ui: show banner when resultant-acl check fails due to permissions or wrong namespace. [GH-23503]
website/docs: Update references to Key Value secrets engine from 'K/V' to 'KV' [GH-24529]
website/docs: fix inaccuracies with unauthenticated_in_flight_requests_access parameter [GH-23287]

BUG FIXES:

Seal HA (enterprise/beta): Fix rejection of a seal configuration change
from two to one auto seal due to persistence of the previous seal type being
"multiseal". [GH-23573]
activity log (enterprise): De-duplicate client count estimates for license utilization reporting.
agent/logging: Agent should now honor correct -log-format and -log-file settings in logs generated by the consul-template library. [GH-24252]
agent: Fix issue where Vault Agent was unable to render KVv2 secrets with delete_version_after set. [GH-25387]
agent: Fixed incorrect parsing of boolean environment variables for configuration. [GH-24790]
api/seal-status: Fix deadlock on calls to sys/seal-status with a namespace configured
on the request. [GH-23861]
api: Fix deadlock on calls to sys/leader with a namespace configured
on the request. [GH-24256]
api: sys/leader ActiveTime field no longer gets reset when we do an internal state change that doesn't change our active status. [GH-24549]
audit/socket: Provide socket based audit backends with 'prefix' configuration option when supplied. [GH-25004]
audit: Fix bug reopening 'file' audit devices on SIGHUP. [GH-23598]
audit: Fix bug where use of 'log_raw' option could result in other devices logging raw audit data [GH-24968]
auth/aws: Fixes a panic that can occur in IAM-based login when a client config does not exist. [GH-23555]
auth/cert: Handle errors related to expired OCSP server responses [GH-24193]
auth/saml (enterprise): Fixes support for Microsoft Entra ID enterprise applications
cap/ldap: Downgrade go-ldap client from v3.4.5 to v3.4.4 due to race condition found [GH-23103]
cassandra: Update Cassandra to set consistency prior to calling CreateSession, ensuring consistency setting is correct when opening connection. [GH-24649]
cli/kv: Undelete now properly handles KV-V2 mount paths that are more than one layer deep. [GH-19811]
cli: fixes plugin register CLI failure to error when plugin image doesn't exist [GH-24990]
command/server: Fix bug with sigusr2 where pprof files were not closed correctly [GH-23636]
core (Enterprise): Treat multiple disabled HA seals as a migration to Shamir.
core (enterprise): Do not return an internal error when token policy type lookup fails, log it instead and continue.
core (enterprise): Fix a panic that can occur if only one seal exists but is unhealthy on the non-first restart of Vault.
core (enterprise): fix a potential deadlock if an error is received twice from underlying storage for the same key
core/activity: Fixes segments fragment loss due to exceeding entry record size limit [GH-23781]
core/audit: Audit logging a Vault response will now use a 5 second context timeout, separate from the original request. [GH-24238]
core/config: Use correct HCL config value when configuring log_requests_level. [GH-24056]
core/ha: fix panic that can occur when an HA cluster contains an active node with version >=1.12.0 and another node with version <1.10 [GH-24441]
core/mounts: Fix reading an "auth" mount using "sys/internal/ui/mounts/" when filter paths are enforced returns 500 error code from the secondary [GH-23802]
core/quotas: Close rate-limit blocked client purge goroutines when sealing [GH-24108]
core: Fix a timeout initializing Vault by only using a short timeout persisting barrier keyring encryption counts. [GH-24336]
core: Fix an error that resulted in the wrong seal type being returned by sys/seal-status while
Vault is in seal migration mode. [GH-24165]
core: Skip unnecessary deriving of policies during Login MFA Check. [GH-23894]
core: fix bug where deadlock detection was always on for expiration and quotas.
These can now be configured individually with detect_deadlocks. [GH-23902]
core: fix policies with wildcards not matching list operations due to the policy path not having a trailing slash [GH-23874]
core: fix rare panic due to a race condition with metrics collection during seal [GH-23906]
core: upgrade github.com/hashicorp/go-kms-wrapping/wrappers/azurekeyvault/v2 to
support azure workload identities. [GH-24954]
eventlogger: Update library to v0.2.7 to address race condition [GH-24305]
events: Ignore sending context to give more time for events to send [GH-23500]
expiration: Fix fatal error "concurrent map iteration and map write" when collecting metrics from leases. [GH-24027]
expiration: Prevent large lease loads from delaying state changes, e.g. becoming active or standby. [GH-23282]
fairshare: fix a race condition in JobManager.GetWorkerCounts [GH-24616]
helper/pkcs7: Fix slice out-of-bounds panic [GH-24891]
http: Include PATCH in the list of allowed CORS methods [GH-24373]
kmip (enterprise): Improve handling of failures due to storage replication issues.
kmip (enterprise): Only return a Server Correlation Value to clients using KMIP version 1.4.
kmip (enterprise): Return a structure in the response for query function Query Server Information.
ldaputil: Disable tests for ARM64 [GH-23118]
mongo-db: allow non-admin database for root credential rotation [GH-23240]
plugins: Fix panic when querying plugin runtimes from a performance secondary follower node.
proxy: Fixed incorrect parsing of boolean environment variables for configuration. [GH-24790]
replication (enterprise): Fix a bug where undo logs would only get enabled on the initial node in a cluster.
replication (enterprise): Fix a missing unlock when changing replication state
replication (enterprise): disallow configuring paths filter for a mount path that does not exist
sdk: Return error when failure occurs setting up node 0 in NewDockerCluster, instead of ignoring it. [GH-24136]
secrets-sync (enterprise): Allow unsyncing secrets from an unmounted secrets engine
secrets-sync (enterprise): Fix panic when setting usage_gauge_period to none
secrets-sync (enterprise): Fixed issue where we could sync a deleted secret
secrets-sync (enterprise): Unsync secret when metadata is deleted
secrets/aws: fix requeueing of rotation entry in cases where rotation fails [GH-23673]
secrets/aws: update credential rotation deadline when static role rotation period is updated [GH-23528]
secrets/consul: Fix revocations when Vault has an access token using specific namespace and admin partition policies [GH-23010]
secrets/pki: Do not set nextUpdate field in OCSP responses when ocsp_expiry is 0 [GH-24192]
secrets/pki: Stop processing in-flight ACME verifications when an active node steps down [GH-23278]
secrets/transit (enterprise): Address an issue using sign/verify operations with managed keys returning an error about it not containing a private key
secrets/transit (enterprise): Address panic when using GCP,AWS,Azure managed keys for encryption operations. At this time all encryption operations for the cloud providers have been disabled, only signing operations are supported.
secrets/transit (enterprise): Apply hashing arguments and defaults to managed key sign/verify operations
secrets/transit: Do not allow auto rotation on managed_key key types [GH-23723]
secrets/transit: Fix a panic when attempting to export a public RSA key [GH-24054]
secrets/transit: When provided an invalid input with hash_algorithm=none, a lock was not released properly before reporting an error leading to deadlocks on a subsequent key configuration update. [GH-25336]
storage/consul: fix a bug where an active node in a specific sort of network
partition could continue to write data to Consul after a new leader is elected
potentially causing data loss or corruption for keys with many concurrent
writers. For Enterprise clusters this could cause corruption of the merkle trees
leading to failure to complete merkle sync without a full re-index. [GH-23013]
storage/raft: Fix a race whereby a new leader may present inconsistent node data to Autopilot. [GH-24246]
transform (enterprise): guard against a panic looking up a token in exportable mode with barrier storage.
ui: Allows users to dismiss the resultant-acl banner. [GH-25106]
ui: Allows users to search within KV v2 directories from the Dashboard's quick action card. [GH-25001]
ui: Assumes version 1 for kv engines when options are null because no version is specified [GH-23585]
ui: Correctly handle directory redirects from pre 1.15.0 Kv v2 list view urls. [GH-24281]
ui: Correctly handle redirects from pre 1.15.0 Kv v2 edit, create, and show urls. [GH-24339]
ui: Decode the connection url for display on the connection details page [GH-23695]
ui: Do not disable JSON display toggle for KV version 2 secrets [GH-25235]
ui: Do not show resultant-acl banner on namespaces a user has access to [GH-25256]
ui: Fix AWS secret engine to allow empty policy_document field. [GH-23470]
ui: Fix JSON editor in KV V2 unable to handle pasted values [GH-24224]
ui: Fix PKI ca_chain display so value can be copied to clipboard [GH-25399]
ui: Fix bug where a change on OpenAPI added a double forward slash on some LIST endpoints. [GH-23446]
ui: Fix copy button not working on masked input when value is not a string [GH-25269]
ui: Fix error when tuning token auth configuration within namespace [GH-24147]
ui: Fix inconsistent empty state action link styles [GH-25209]
ui: Fix payload sent when disabling replication [GH-24292]
ui: Fix regression that broke the oktaNumberChallenge on the ui. [GH-23565]
ui: Fix the copy token button in the sidebar navigation window when in a collapsed state. [GH-23331]
ui: Fixed minor bugs with database secrets engine [GH-24947]
ui: Fixes input for jwks_ca_pem when configuring a JWT auth method [GH-24697]
ui: Fixes issue where you could not share the list view URL from the KV v2 secrets engine. [GH-23620]
ui: Fixes issue with sidebar navigation links disappearing when navigating to policies when a user is not authorized [GH-23516]
ui: Fixes issues displaying accurate TLS state in dashboard configuration details [GH-23726]
ui: Fixes policy input toolbar scrolling by default [GH-23297]
ui: The UI can now be used to create or update database roles by operator without permission on the database connection. [GH-24660]
ui: Update the KV secret data when you change the version you're viewing of a nested secret. [GH-25152]
ui: Updates OIDC/JWT login error handling to surface all role related errors [GH-23908]
ui: Upgrade HDS version to fix sidebar navigation issues when it collapses in smaller viewports. [GH-23580]
ui: When Kv v2 secret is an object, fix so details view defaults to readOnly JSON editor. [GH-24290]
ui: fix KV v2 details view defaulting to JSON view when secret value includes { [GH-24513]
ui: fix broken GUI when accessing from listener with chroot_namespace defined [GH-23942]
ui: fix incorrectly calculated capabilities on PKI issuer endpoints [GH-24686]
ui: fix issue where kv v2 capabilities checks were not passing in the full secret path if secret was inside a directory. [GH-24404]
ui: fix navigation items shown to user when chroot_namespace configured [GH-24492]
ui: show error from API when seal fails [GH-23921]