Class Metric (1.140.0)

Metric(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The metric used for running evaluations.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes

Name Description
predefined_metric_spec google.cloud.aiplatform_v1beta1.types.PredefinedMetricSpec
The spec for a pre-defined metric. This field is a member of oneof_ metric_spec.
computation_based_metric_spec google.cloud.aiplatform_v1beta1.types.ComputationBasedMetricSpec
Spec for a computation based metric. This field is a member of oneof_ metric_spec.
llm_based_metric_spec google.cloud.aiplatform_v1beta1.types.LLMBasedMetricSpec
Spec for an LLM based metric. This field is a member of oneof_ metric_spec.
pointwise_metric_spec google.cloud.aiplatform_v1beta1.types.PointwiseMetricSpec
Spec for pointwise metric. This field is a member of oneof_ metric_spec.
pairwise_metric_spec google.cloud.aiplatform_v1beta1.types.PairwiseMetricSpec
Spec for pairwise metric. This field is a member of oneof_ metric_spec.
exact_match_spec google.cloud.aiplatform_v1beta1.types.ExactMatchSpec
Spec for exact match metric. This field is a member of oneof_ metric_spec.
bleu_spec google.cloud.aiplatform_v1beta1.types.BleuSpec
Spec for bleu metric. This field is a member of oneof_ metric_spec.
rouge_spec google.cloud.aiplatform_v1beta1.types.RougeSpec
Spec for rouge metric. This field is a member of oneof_ metric_spec.
aggregation_metrics MutableSequence[google.cloud.aiplatform_v1beta1.types.Metric.AggregationMetric]
Optional. The aggregation metrics to use.

Classes

AggregationMetric

AggregationMetric(value)

The per-metric statistics on evaluation results supported by EvaluationService.EvaluateDataset.

Methods

Metric

Metric(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The metric used for running evaluations.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields