Evaluation.GoldenExpectation

Represents a single, checkable requirement.

JSON representation
{
  "note": string,

  // Union field condition can be only one of the following:
  "toolCall": {
    object (ToolCall)
  },
  "toolResponse": {
    object (ToolResponse)
  },
  "agentResponse": {
    object (Message)
  },
  "agentTransfer": {
    object (AgentTransfer)
  },
  "updatedVariables": {
    object
  }
  // End of list of possible types for union field condition.
}
Fields
note

string

Optional. A note for this requirement, useful in reporting when specific checks fail. E.g., "Check_Payment_Tool_Called".

Union field condition. The actual check to perform. condition can be only one of the following:
toolCall

object (ToolCall)

Optional. Check that a specific tool was called with the parameters.

toolResponse

object (ToolResponse)

Optional. Check that a specific tool had the expected response.

agentResponse

object (Message)

Optional. Check that the agent responded with the correct response. The role "agent" is implied.

agentTransfer

object (AgentTransfer)

Optional. Check that the agent transferred the conversation to a different agent.

updatedVariables

object (Struct format)

Optional. Check that the agent updated the session variables to the expected values. Used to also capture agent variable updates for golden evals.