Reference documentation and code samples for the Gemini Enterprise for Customer Experience V1BETA API class Google::Cloud::Ces::V1beta::EvaluationResult::ScenarioResult.
The outcome of a scenario evaluation.
Inherits
- Object
Extended By
- Google::Protobuf::MessageExts::ClassMethods
Includes
- Google::Protobuf::MessageExts
Methods
#all_expectations_satisfied
def all_expectations_satisfied() -> ::Boolean
Returns
- (::Boolean) — Output only. Whether all expectations were satisfied for this turn.
#conversation
def conversation() -> ::String
Returns
- (::String) — Output only. The conversation that was generated in the scenario.
#evaluation_expectation_results
def evaluation_expectation_results() -> ::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::EvaluationExpectationResult>
Returns
- (::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::EvaluationExpectationResult>) — Output only. The results of the evaluation expectations.
#expectation_outcomes
def expectation_outcomes() -> ::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::ScenarioExpectationOutcome>
Returns
- (::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::ScenarioExpectationOutcome>) — Output only. The outcome of each expectation.
#hallucination_result
def hallucination_result() -> ::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::HallucinationResult>
Returns
- (::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::HallucinationResult>) — Output only. The result of the hallucination check. There will be one hallucination result for each turn in the conversation.
#rubric_outcomes
def rubric_outcomes() -> ::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::ScenarioRubricOutcome>
Returns
- (::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::ScenarioRubricOutcome>) — Output only. The outcome of the rubric.
#span_latencies
def span_latencies() -> ::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::SpanLatency>
Returns
- (::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::SpanLatency>) — Output only. The latency of spans in the conversation.
#task
def task() -> ::String
Returns
- (::String) — Output only. The task that was used when running the scenario for this result.
#task_completed
def task_completed() -> ::Boolean
Returns
- (::Boolean) — Output only. Whether the task was completed for this turn. This is a composite of all expectations satisfied, no hallucinations, and user goal satisfaction.
#task_completion_result
def task_completion_result() -> ::Google::Cloud::Ces::V1beta::EvaluationResult::TaskCompletionResult
Returns
- (::Google::Cloud::Ces::V1beta::EvaluationResult::TaskCompletionResult) — Output only. The result of the task completion check.
#tool_call_latencies
def tool_call_latencies() -> ::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::ToolCallLatency>
Returns
- (::Array<::Google::Cloud::Ces::V1beta::EvaluationResult::ToolCallLatency>) — Output only. The latency of each tool call execution in the conversation.
#user_facts
def user_facts() -> ::Array<::Google::Cloud::Ces::V1beta::Evaluation::Scenario::UserFact>
Returns
- (::Array<::Google::Cloud::Ces::V1beta::Evaluation::Scenario::UserFact>) — Output only. The user facts that were used by the scenario for this result.
#user_goal_satisfaction_result
def user_goal_satisfaction_result() -> ::Google::Cloud::Ces::V1beta::EvaluationResult::UserGoalSatisfactionResult
Returns
- (::Google::Cloud::Ces::V1beta::EvaluationResult::UserGoalSatisfactionResult) — Output only. The result of the user goal satisfaction check.