Agent

Prelude

Release on: 2024-03-21

• Please refer to the 7.52.0 tag on integrations-core for the list of changes on the Core Checks

Upgrade Notes

• To prevent misconfigurations, the Windows Datadog Agent installer now raises an error if the user account running the installer MSI is provided as the ddagentuser (DDAGENTUSER_NAME) account. If the account is a service account, such as LocalSystem or a gMSA account, no action is needed. If the account is a regular account, configure a different Datadog Agent service account.

New Features

• Add device_type to the device metadata.
• Attach host tags to metrics for expected_tags_duration amount of time.
• APM stats will now include, if present, the Git commit SHA from traces (or container tags) and the image tag from container tags.
• Creation of a new packageSigning component to collect Linux package signature information and improve signature rotation process. More information can be found in DataDog documentation at 2024 linux key rotation.
• Adds support for span links in the trace agent. This field contains a list of casual relationships between spans and is only populated when v0.4 of the Trace API is used.
• The Windows Agent now supports CWS for process and network threats.
• CWS: Add chdir event to allow recent container escape detection.
• CWS: [BETA] Add File Integrity Monitoring support on Windows, supporting both files and registry.
• CWS: The Agent now automatically suppresses benign security events if they have already been reported for a particular container image.
• Updating process agent discovery configuration to include a Data Scrubber for obfuscating sensitive information such as passwords, API keys, or tokens.
• Add support for pinging network devices in the SNMP integration.
• [oracle] Add oracle.locks.transaction_duration metric.
• APM: Add support for Single Step Instrumentation remote configuration
• Headless agent installation support on macOS 14 and later

Enhancement Notes

• [DBM] Increase the DBM dbm-metrics-intake endpoint's defaultInputChanSize value to 500.
• Add debug level logs when files are evicted from registry.json after their TTL expires.
• Add the instance ID returned by the IMDSv2 metadata endpoint to the list of EC2 host aliases.
• This change adds journald permissions to the flare in the logs_file_permissions.log file, in the form of either the journald directory or a specific file (if specified by the Agent journald configuration).
• The Logs Agent now creates a file in the flare, called logs_file_permissions.log, which lists every file and that file's permissions that the Logs Agent can detect.
• Add the SBOM check to the output of the Agent status command and the Agent flare.
• Add the Software Bill of Materials (SBOM) for container images to the output of the flare command.
• Add repo_digest to containerd ContainerImage to remove duplicate images in container images UI.
• Agents are now built with Go 1.21.7.
• Agents are now built with Go 1.21.8.
• CWS: Improved coverage on platforms with no eBPF support.
• CWS: Send context of variables in events.
• Add DD_APM_DEBUGGER_DIAGNOSTICS_DD_URL, DD_APM_DEBUGGER_DIAGNOSTICS_API_KEY, and DD_APM_DEBUGGER_DIAGNOSTICS_ADDITIONAL_ENDPOINTS to allow sending Live Debugger / Dynamic Instrumentation diagnostic data to multiple intakes.
• Added config that allows user to toggle on and off the collection of zombie processes in the Process Agent.
• [oracle] Add ddagenthostname tag.
• [oracle]: Add oracle.tablespace.maxsize metric.
• OTLP ingest supports stable Java runtime metrics introduced in opentelemetry-java-instrumentation v2.0.0. OTLP ingest supports Kafka metrics mapping. This allows users of the JMX Receiver/JMX Metrics Gatherer and Kafka metrics receiver to have access to the OOTB Kafka Dashboard.
• Modified the process check to populate process with the newly created field "ProcessContext"
• Rename the kubelet_core check to kubelet and change the metrics prefix from kubernetes_core to kubernetes so that it can replace the Python kubelet check.
• APM: Adds msgp_short_bytes reason for trace payloads dropped to distinguish them from EOF errors.
• When getting resource tags from an ECS task with zero containers, print a warn log instead of error log.

Deprecation Notes

• Removal of the pod check from the process agent. The current check will run from the core agent.
• This release drops support for Red Hat Enterprise Linux 6 and its derivatives.
• [oracle] Deprecate the configuration parameter instant_client. Replacing it with oracle_client.
• Removed the system-probe configuration value data_streams_config.enabled and replaced it with service_monitoring_config.enable_kafka_monitoring. This also implies that the DsmEnabled field in the AgentConfiguration proto will consistently be set to false.

Bug Fixes

• Upgrade dependencies for systemd core check. This silences excessive warning logs on systemd v252.
• oracle: Fix wrong tablespace metrics.
• APM: Stop dropping incoming OTel payloads when the processing channel is full and eliminate OOM issues in the trace agent and collector component in high load scenarios, making the OTel pipeline more reliable.
• Fix dogstatsd-capture. Message PID was not set after the 7.50 release.
• Fix a memory exception where the flare controller tries to stat a file that doesn't exist.
• Fleet Automation filters in the Datadog UI now accurately reflect which products are enabled when deployed with the official DataDog Helm chart on Kubernetes.
• Corrected a problem where the ignore_autodiscovery_tags parameter was not functioning correctly with pod annotations or autodiscovery version 2 (adv2) annotations. This fix ensures that when this parameter is set to true, autodiscovery tags are ignored as intended. Example:

yaml ad.datadoghq.com/redis.checks: | { "redisdb": { "ignore_autodiscovery_tags": true, "instances": [ { "host": "%%host%%", "port": "6379" } ] } }
Moving forward, configurations that attempt to use hybrid setups—combining adv2 for check specification while also employing `adv1 for ignore_autodiscovery_tags—are no longer supported by default. Users should set the configuration parameter cluster_checks.support_hybrid_ignore_ad_tags to true to enable this behavior.

• [oracle]: Add support for more Asian character sets.
• Prevention of OOMs when collecting a large number of zombie processes.
• Fixed race conditions caused by concurrent execution of etw.StartEtw() and etw.StopEtw() functions which may concurrently access and modify a global map.
• Fix recent PR #22664 which in turn fixes a race condition in the ETW package. The previous PR introduced a minor error addressed in this PR.
• [oracle] Add resource_manager configuration to conf.yaml.example.
• [oracle] Fix multi-tagging bug.
• Fixes a bug in OTLP ingest where empty histograms were not being sent to the backend in the distributions mode. Empty histograms are now mapped as if they had a single (min, max) bucket.
• Scrub authentication bearer token of any size, even invalid, from integration configuration (when being printed through the checksconfig CLI command or other).
• Empty UDS payloads no longer cause the DogStatsD server to close the socket.

Other Notes

• The version of Python required for tooling in README matches that which the CI uses.

Datadog Cluster Agent

New Features

• Add agent sidecar injection webhook in cluster-agent Kubernetes admission controller. This new webhook adds the Agent as sidecar container in applicative Pods when it is required by the environment. For example with the EKS Fargate environment.

Enhancement Notes

• Introduces a new config option in the Cluster Agent to set the rebalance period when advanced dispatching is enabled: cluster_checks.rebalance_period. The default value is 10 min.

Bug Fixes

• Fix an issue where the admission controller would remove the field restartPolicy from native sidecar containers, preventing pod creation on Kubernetes 1.29+.
• Fix missing kube_api_version tag on HPA and VPA resources.