EvaluationMetricsThresholds(mapping=None, *, ignore_unknown_fields=False, **kwargs)Threshold settings for metrics in an Evaluation.
Attributes |
|
|---|---|
| Name | Description |
golden_evaluation_metrics_thresholds |
google.cloud.ces_v1beta.types.EvaluationMetricsThresholds.GoldenEvaluationMetricsThresholds
Optional. The golden evaluation metrics thresholds. |
hallucination_metric_behavior |
google.cloud.ces_v1beta.types.EvaluationMetricsThresholds.HallucinationMetricBehavior
Optional. Deprecated: Use golden_hallucination_metric_behavior instead. The
hallucination metric behavior is currently used for golden
evaluations.
|
golden_hallucination_metric_behavior |
google.cloud.ces_v1beta.types.EvaluationMetricsThresholds.HallucinationMetricBehavior
Optional. The hallucination metric behavior for golden evaluations. |
scenario_hallucination_metric_behavior |
google.cloud.ces_v1beta.types.EvaluationMetricsThresholds.HallucinationMetricBehavior
Optional. The hallucination metric behavior for scenario evaluations. |
Classes
GoldenEvaluationMetricsThresholds
GoldenEvaluationMetricsThresholds(
mapping=None, *, ignore_unknown_fields=False, **kwargs
)Settings for golden evaluations.
HallucinationMetricBehavior
HallucinationMetricBehavior(value)The hallucination metric behavior. Regardless of the behavior, the metric will always be calculated. The difference is that when disabled, the metric is not used to calculate the overall evaluation score.
ToolMatchingSettings
ToolMatchingSettings(mapping=None, *, ignore_unknown_fields=False, **kwargs)Settings for matching tool calls.