Evaluation.ScenarioExpectation

The expectation to evaluate the conversation produced by the simulation.

JSON representation 
{

  // Union field expectation can be only one of the following:
  "toolExpectation": {
    object (Evaluation.ScenarioExpectation.ToolExpectation)
  },
  "agentResponse": {
    object (Message)
  }
  // End of list of possible types for union field expectation.
}
Fields
Union field expectation. The expectation to evaluate the conversation produced by the simulation. expectation can be only one of the following:
toolExpectation

object (Evaluation.ScenarioExpectation.ToolExpectation)

Optional. The tool call and response pair to be evaluated.
agentResponse

object (Message)

Optional. The agent response to be evaluated.

Evaluation.ScenarioExpectation.ToolExpectation

The tool call and response pair to be evaluated.

JSON representation 
{
  "expectedToolCall": {
    object (ToolCall)
  },
  "mockToolResponse": {
    object (ToolResponse)
  }
}
Fields
expectedToolCall

object (ToolCall)

Required. The expected tool call, with the parameters of interest specified. Any parameters not specified will be hallucinated by the LLM.
mockToolResponse

object (ToolResponse)

Required. The tool response to mock, with the parameters of interest specified. Any parameters not specified will be hallucinated by the LLM.