Azure/azure-sdk-for-python azure-ai-evaluation_1.0.0b4

on GitHub

1.0.0b4 (2024-10-16)

Breaking Changes

• Removed numpy dependency. All NaN values returned by the SDK have been changed to from numpy.nan to math.nan.
• credential is now required to be passed in for all content safety evaluators and ProtectedMaterialsEvaluator. DefaultAzureCredential will no longer be chosen if a credential is not passed.
• Changed package extra name from "pf-azure" to "remote".

Bugs Fixed

• Adversarial Conversation simulations would fail with Forbidden. Added logic to re-fetch token in the exponential retry logic to retrive RAI Service response.

Other Changes

• Enhance the error message to provide clearer instruction when required packages for the remote tracking feature are missing.