Agent

Prelude

Released on: 2025-01-29

• Please refer to the 7.62.0 tag on integrations-core for the list of changes on the Core Checks

New Features

• The Agent will now tag TLS enhanced metrics like tls_version and tls_cipher. This will allow you to filter and aggregate metrics based on the TLS version and cipher used in the connection. The tags will be added in CNM and USM.
• Add new system.cpu.user.total, system.cpu.nice.total, system.cpu.system.total, system.cpu.idle.total, system.cpu.iowait.total, system.cpu.irq.total, system.cpu.softirq.total, system.cpu.steal.total, system.cpu.guest.total, system.cpu.guestnice.total metrics with core tag for each one of them.
• Implement External Data resolution for APM. This is needed to support the latest Origin Detection spec and resolution with nested virtualization.
• The Logs Agent Analyze feature introduces a new subcommand, agent analyze-logs, within the Datadog Agent. This tool helps users test log configurations, regular expressions, and processing rules in isolation. It offers a streamlined, cost-effective way to validate log configurations without running the entire Datadog Agent or sending data to Datadog. This allows users to quickly identify configuration issues.

Enhancement Notes

• On Windows, Agent flares now include event logs for .NET applications.

• Emit new field: integration for TopologyLinkMetadata for better metrics collection.

• Adds tagger tags to pod manifests.

• Added the output of sestatus into the Agent flare. This information will appear in system-probe/selinux_sestatus.log.

• Extended Agent telemetry histogram details, specifically:

  • Added previously omitted and implicit +Inf bucket value to histogram payload.
  • Added p75, p95, and p99 histogram values (expressed as the upper-bound for the matching bucket).

• Use HTTP zstd compression for the Agent telemetry payloads.

• Agents are now built with Go 1.23.3.

• Added the output of semodule -l to the Agent flare; this information appears in system-probe/selinux_semodule_list.log.

• Metric payloads are compressed using zstd compression by default. This can be reverted to the previous compression kind by adding serializer_compressor_kind: zlib to the configuration.

• Network Path will use recent DNS lookups to infer the destination hostname, if they are available. If a DNS lookup is not found, it will query reverse DNS the same way as before.

• Adds support for the none cardinality type in the tagger.

• For OpenTelemetry GraphQL request spans, the span resource name is now the GraphQL operation type and name.

• All process agent endpoints now require authentication.

• Extends extra configuration available for templating from Aurora Database Discovery to include %%extra_dbname%% allowing instances which are configured with non-standard DBName field to be discovered successfully

• APM: The trace agent endpoint for changing the configured log level now requires authentication so it is only accessible to other Agent processes.

Deprecation Notes

• CWS: the runtime_security_config.policies.watch_dir option has been removed. Use remote configuration for dynamically updating policies, or send the SIGHUP signal to the system-probe process to reload the policies.
• SNMP profiles containing metric_tags without a specified tag field will now show an error and be ignored, similar to other profile syntax errors.

Security Notes

• Move the embedded Python cache out of the installation directory on Windows.

Bug Fixes

• Upgrade gstatus binary to version 1.0.9 to work with newer version of GlusterFS.
• Fix Windows file permissions on authToken to give access to the Datadog user even when privilege processes create it.
• Fixes Windows CTRL-C handler on the agent run command.
• Corrects host tagging for the oracle.can_connect service check
• Use /var/run/syslog as the default syslog socket path on macOS.
• Fixes consistency issue with container image filters. Depending on the Agent configuration, filters were sometimes behaving differently for metrics and logs. For example, an image filter that worked for excluding logs didn't work when used to exclude metrics, and vice versa. The exclusion logic is now consistent between metrics and logs.
• Fixed race condition in stream UDS clients of Dogstatsd that allowed for the loss of received data.

Other Notes

• Add metrics origins for Quarkus integration.
• Add metric origins for Platform Integrations: Cloud Foundry, Jenkins, KubeVirt API, KubeVirt Controller, and KubeVirt Handler.

Datadog Cluster Agent

Prelude

Released on: 2025-01-29 Pinned to datadog-agent v7.62.0: CHANGELOG.

Enhancement Notes

• Added support for EndpointSlices in the metadata controller. This feature, enabled by setting kubernetesUseEndpointSlices to true, resolves limitations of Endpoints resources, particularly for services with more than 1000 addresses. Must add endpointslices to DCA cluster role.
• The kubernetes_state_core check now collects only metadata for configmaps, reducing memory, CPU, and network usage in the Cluster Agent while preserving full metric functionality.
• The Datadog Cluster Agent admission controller agent sidecar injection now sets up Agent sidecars to run with securityContext of readOnlyRootFilesystem:false by default. Advanced users can customize the securityContext via clusterAgent.admissionController.agentSidecarInjection.profiles.

Bug Fixes

• Resolved a bug where kube_service tags were not properly deleted when a service's ties to pods on a specific node were removed but the service itself was not deleted.
• Add mapping for apiservices and customresourcedefinitions to KSM check to prevent errors on startup with discovering resources.
• Include gpu_vendor pod tags on the Datadog Cluster Agent when enabling datadog.clusterTagger.collectKubernetesTags.
• When the Datadog Cluster Agent injects the Datadog Agent as a sidecar on a Job, the agent will now exit when the main Job completes.