Minor Changes
- bc2be45: Adds
t.score(evaluation)for recording a score from 0 to 1, named with.label(key)and gated with.gate()or.atLeast().AssertionResultgainskey, andscore,threshold, andpassedare now optional:scoreis absent when the scorer threw, andthresholdandpassedare absent when no rule applies, so custom reporters should treatpassed === falseas the failure signal.eve evalwarns when soft assertions in one eval share a name with different scores.
Patch Changes
- 76f6854: eve's agent spans now come from the shared tracing library, and durable turns recover from one checkpoint per turn. Each tool call is still one
execute_toolspan, a local subagent's first turn still nests under its caller, and trace schema version 4 is unchanged. - f5e5183: Connection approval policies now receive
toolAnnotations, the hints an MCP server declared for the called tool (such asreadOnlyHintanddestructiveHint), so a policy can skip approval for read-only tools. It isundefinedwhen the server declares none. - 302a4d3: Tools can now define
approval.promptto show a human-readable, input-aware summary in approval requests. Slack keeps the complete tool input available in a collapsed block below the approval card. - 422b628: Extract reusable agent tracing with wrapped execution, model stream completion, remote delegation, and durable turns that save and resume themselves through a checkpointer. Preserve trace schema version 4 while sharing one span lifecycle with eve.
- 485d0f5: The agent tracing library now writes schema 4's
agent.action.kind,agent.action.name, andagent.action.outcomeon tool and approval spans itself, so hosts other than eve render correctly in Agent Runs. eve's trace output is unchanged.