ScenarioResult(mapping=None, *, ignore_unknown_fields=False, **kwargs)The outcome of a scenario evaluation.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
Attributes |
|
|---|---|
| Name | Description |
conversation |
str
Output only. The conversation that was generated in the scenario. |
task |
str
Output only. The task that was used when running the scenario for this result. |
user_facts |
MutableSequence[google.cloud.ces_v1beta.types.Evaluation.Scenario.UserFact]
Output only. The user facts that were used by the scenario for this result. |
expectation_outcomes |
MutableSequence[google.cloud.ces_v1beta.types.EvaluationResult.ScenarioExpectationOutcome]
Output only. The outcome of each expectation. |
rubric_outcomes |
MutableSequence[google.cloud.ces_v1beta.types.EvaluationResult.ScenarioRubricOutcome]
Output only. The outcome of the rubric. |
hallucination_result |
MutableSequence[google.cloud.ces_v1beta.types.EvaluationResult.HallucinationResult]
Output only. The result of the hallucination check. There will be one hallucination result for each turn in the conversation. |
task_completion_result |
google.cloud.ces_v1beta.types.EvaluationResult.TaskCompletionResult
Output only. The result of the task completion check. |
tool_call_latencies |
MutableSequence[google.cloud.ces_v1beta.types.EvaluationResult.ToolCallLatency]
Output only. The latency of each tool call execution in the conversation. |
user_goal_satisfaction_result |
google.cloud.ces_v1beta.types.EvaluationResult.UserGoalSatisfactionResult
Output only. The result of the user goal satisfaction check. |
all_expectations_satisfied |
bool
Output only. Whether all expectations were satisfied for this turn. This field is a member of oneof_ _all_expectations_satisfied.
|
task_completed |
bool
Output only. Whether the task was completed for this turn. This is a composite of all expectations satisfied, no hallucinations, and user goal satisfaction. This field is a member of oneof_ _task_completed.
|
span_latencies |
MutableSequence[google.cloud.ces_v1beta.types.EvaluationResult.SpanLatency]
Output only. The latency of spans in the conversation. |
evaluation_expectation_results |
MutableSequence[google.cloud.ces_v1beta.types.EvaluationResult.EvaluationExpectationResult]
Output only. The results of the evaluation expectations. |