Represents a single, checkable requirement.
| JSON representation |
|---|
{ "note": string, // Union field |
| Fields | |
|---|---|
note |
Optional. A note for this requirement, useful in reporting when specific checks fail. E.g., "Check_Payment_Tool_Called". |
Union field condition. The actual check to perform. condition can be only one of the following: |
|
toolCall |
Optional. Check that a specific tool was called with the parameters. |
toolResponse |
Optional. Check that a specific tool had the expected response. |
agentResponse |
Optional. Check that the agent responded with the correct response. The role "agent" is implied. |
agentTransfer |
Optional. Check that the agent transferred the conversation to a different agent. |
updatedVariables |
Optional. Check that the agent updated the session variables to the expected values. Used to also capture agent variable updates for golden evals. |