What's Changed
Core Improvements & Fixes
- Used production WorkOS environment ID
- Added SQLite FTS5 support to test workflow
- Fixed agent knowledge handling
- Compared using
BaseLLM
class instead ofLLM
- Fixed missing
create_directory
parameter inTask
class
New Features & Enhancements
- Introduced Agent evaluation functionality
- Added Evaluator experiment and regression testing methods
- Implemented thread-safe
AgentEvaluator
- Enabled event emission for Agent evaluation
- Supported evaluation of single
Agent
andLiteAgent
- Added integration with
neatlogs
- Added crew context tracking for LLM guardrail events
Documentation & Guides
- Added documentation for
guardrail
attributes and usage examples - Added integration guide for
neatlogs
- Updated documentation for Agent repository and
Agent.kickoff
usage