Class GoldenExpectation (0.3.0)

GoldenExpectation(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Represents a single, checkable requirement.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes

Name Description
tool_call google.cloud.ces_v1beta.types.ToolCall
Optional. Check that a specific tool was called with the parameters. This field is a member of oneof_ condition.
tool_response google.cloud.ces_v1beta.types.ToolResponse
Optional. Check that a specific tool had the expected response. This field is a member of oneof_ condition.
agent_response google.cloud.ces_v1beta.types.Message
Optional. Check that the agent responded with the correct response. The role "agent" is implied. This field is a member of oneof_ condition.
agent_transfer google.cloud.ces_v1beta.types.AgentTransfer
Optional. Check that the agent transferred the conversation to a different agent. This field is a member of oneof_ condition.
updated_variables google.protobuf.struct_pb2.Struct
Optional. Check that the agent updated the session variables to the expected values. Used to also capture agent variable updates for golden evals. This field is a member of oneof_ condition.
mock_tool_response google.cloud.ces_v1beta.types.ToolResponse
Optional. The tool response to mock, with the parameters of interest specified. Any parameters not specified will be hallucinated by the LLM. This field is a member of oneof_ condition.
note str
Optional. A note for this requirement, useful in reporting when specific checks fail. E.g., "Check_Payment_Tool_Called".