artilleryio/artillery artillery-2.0.1 on GitHub

CLI & Core

Add time unit support for think steps in scenarios (#2272)
metrics-by-endpoint plugin is now enabled by default to capture per-URL metrics in HTTP tests. The metrics will be available only in the JSON report and not output to the console, unless the plugin is loaded explicitly by the user. (#2274)
Configure CPU and memory for Fargate tests with --cpu and --memory flags (#2301)
Fix issue with $env not resolving correctly in the config section (#2265)
Fix an issue with --scenario-name not picking up the correct scenario (#2314)
Add a new fake-data plugin to allow for realistic test data to be generated in your tests (#2318) (docs)
Fix handling of metrics with non-alphanumeric characters in ensure checks (#2284)
Improve error handling in the expect plugin (#2298)

Add experimental tracing support for Playwright tests, with tracing of test.step() calls, page navigation events, and Core Web Vitals metrics (#2259)
Improve conformance to OTel semantic conventions:
- Include error messages for spans with HTTP response codes of 400 or higher (#2285)
- Include HTTP_REQUEST_CONTENT_LENGTH, HTTP_USER_AGENT and HTTP_FLAVOR attributes (#2285)
Fix issue with virtual user ID attribute (vu.uuid) not always being set correctly
Fix inconsistencies in error handling (#2298 & #2285)

Add experimental tracing support via OpenTelemetry with publish-metrics plugin (#2259)
Fix FID Core Web Vital metric not being emitted as expected

Configure CPU and memory for Fargate tests with --cpu and --memory flags (#2301)

Allow validation of any number of arguments in response/acknowledge with new args/on options (#2171)
More flexible validations with ability to wait for multiple responses (#2139)
Fix issue with displaying match errors in the report