2.3.0 (2026-08-06)
Features Added
- Added task-generation support to
BetaDatasetsClient/BetaDatasetsAsyncClient: newDataGenerationJobType.TASK_GENERATIONvalue and newTaskGenerationDataGenerationJobOptionssubtype for thetask_generationdata generation scenario, intended for multi-turn evaluation with prompt, file, or agent sources. - Added rubric-generation input-quality warnings on
BetaEvaluatorsClient/BetaEvaluatorsAsyncClient:EvaluatorGenerationJob.getInputQualityWarnings()returns any non-fatal input-quality advisories produced by the rubric generation pipeline.EvaluatorVersion.getGenerationJobId()andEvaluatorVersion.getWarnings()provide the read-only link back to theEvaluatorGenerationJobthat produced the version and the categories of warnings surfaced on it.- New models
GenerationWarningType,RubricGenerationInputQualityWarning,RubricGenerationInputQualityWarningCode,RubricGenerationInputQualityWarningSeverity, andRubricGenerationInputQualityWarningSource.
- Marked
HumanEvaluationPreviewRuleActionwith@Betaso preview surface area is explicit in generated API docs.
Breaking Changes
BetaDatasetsClient/BetaDatasetsAsyncClientdata generation job creation is now a long-running operation.createGenerationJob(DataGenerationJob, String),createGenerationJob(DataGenerationJob), andcreateGenerationJobWithResponse(BinaryData, RequestOptions)were removed and replaced bybeginCreateGenerationJoboverloads returningSyncPoller<DataGenerationJob, DataGenerationJobResult>/PollerFlux<DataGenerationJob, DataGenerationJobResult>. Call.poll().getValue()(or the async equivalent) to obtain the createdDataGenerationJob.BetaEvaluatorsClient/BetaEvaluatorsAsyncClientevaluator generation job creation is now a long-running operation.createEvaluatorGenerationJob(EvaluatorGenerationJob, String),createEvaluatorGenerationJob(EvaluatorGenerationJob), andcreateEvaluatorGenerationJobWithResponse(BinaryData, RequestOptions)were removed and replaced bybeginCreateEvaluatorGenerationJoboverloads returningSyncPoller<EvaluatorGenerationJob, EvaluatorVersion>/PollerFlux<EvaluatorGenerationJob, EvaluatorVersion>.
Other Changes
- Updated version of
openaiclient library to4.45.0. - Regenerated client from the updated TypeSpec specification.