github Azure/azure-sdk-for-python azure-ai-evaluation_1.16.2

4 hours ago

1.16.2 (2026-03-24)

Bugs Fixed

  • Fixed adversarial chat target incorrectly using user's callback instead of RAI service, causing callback response to appear as user message in red team scan results when using converter strategies (e.g., DIFFICULT, Tense).
  • Fixed hate_unfairness attack success rate always reporting 0% due to metric name mapping using legacy hate_fairness name instead of canonical hate_unfairness.
  • Fixed TypeError in multi-turn and crescendo attacks caused by PyRIT 0.11+ renaming send_prompt_async parameter from prompt_request to message.
  • Expanded endpoint normalization (/openai/v1 suffix) to all Azure OpenAI host suffixes (including sovereign clouds), fixing 404 errors for classic AOAI endpoints with PyRIT 0.11+.
  • Added aml-aca-token credential fallback for agent-type seed requests when running locally without ACA managed identity.
  • Extract RAI scorer token metrics (prompt_tokens, completion_tokens, total_tokens) into Score metadata and propagate through result processing for downstream aggregation.

Don't miss a new azure-sdk-for-python release

NewReleases is sending notifications on new releases.