1.0.0b1 (2024-09-20)
Breaking Changes
- The
synthetic
namespace has been renamed tosimulator
, and sub-namespaces under this module have been removed - The
evaluate
andevaluators
namespaces have been removed, and everything previously exposed in those modules has been added to the root namespaceazure.ai.evaluation
- The parameter name
project_scope
in content safety evaluators have been renamed toazure_ai_project
for consistency with evaluate API and simulators. - Model configurations classes are now of type
TypedDict
and are exposed in theazure.ai.evaluation
module instead of coming frompromptflow.core
. - Updated the parameter names for
question
andanswer
in built-in evaluators to more generic terms:query
andresponse
.
Features Added
- First preview
- This package is port of
promptflow-evals
. New features will be added only to this package moving forward. - Added a
TypedDict
forAzureAIProject
that allows for better intellisense and type checking when passing in project information