Class EvaluateInstancesResponse (1.129.0)

Version latest

• 1.122.0 (latest)
• 1.121.0
• 1.120.0
• 1.119.0
• 1.118.0
• 1.117.0
• 1.95.1
• 1.94.0
• 1.93.1
• 1.92.0
• 1.91.0
• 1.90.0
• 1.89.0
• 1.88.0
• 1.87.0
• 1.86.0
• 1.85.0
• 1.84.0
• 1.83.0
• 1.82.0
• 1.81.0
• 1.80.0
• 1.79.0
• 1.78.0
• 1.77.0
• 1.76.0
• 1.75.0
• 1.74.0
• 1.73.0
• 1.72.0
• 1.71.1
• 1.70.0
• 1.69.0
• 1.68.0
• 1.67.1
• 1.66.0
• 1.65.0
• 1.63.0
• 1.62.0
• 1.60.0
• 1.59.0

EvaluateInstancesResponse(
    *,
    rubricBasedMetricResult: typing.Optional[
        vertexai._genai.types.common.RubricBasedMetricResult
    ] = None,
    metricResults: typing.Optional[
        list[vertexai._genai.types.common.MetricResult]
    ] = None,
    bleuResults: typing.Optional[vertexai._genai.types.common.BleuResults] = None,
    cometResult: typing.Optional[vertexai._genai.types.common.CometResult] = None,
    exactMatchResults: typing.Optional[
        vertexai._genai.types.common.ExactMatchResults
    ] = None,
    metricxResult: typing.Optional[vertexai._genai.types.common.MetricxResult] = None,
    pairwiseMetricResult: typing.Optional[
        vertexai._genai.types.common.PairwiseMetricResult
    ] = None,
    pointwiseMetricResult: typing.Optional[
        vertexai._genai.types.common.PointwiseMetricResult
    ] = None,
    rougeResults: typing.Optional[vertexai._genai.types.common.RougeResults] = None,
    toolCallValidResults: typing.Optional[
        vertexai._genai.types.common.ToolCallValidResults
    ] = None,
    toolNameMatchResults: typing.Optional[
        vertexai._genai.types.common.ToolNameMatchResults
    ] = None,
    toolParameterKeyMatchResults: typing.Optional[
        vertexai._genai.types.common.ToolParameterKeyMatchResults
    ] = None,
    toolParameterKvMatchResults: typing.Optional[
        vertexai._genai.types.common.ToolParameterKVMatchResults
    ] = None
)

Result of evaluating an LLM metric.

Methods

EvaluateInstancesResponse

EvaluateInstancesResponse(
    *,
    rubricBasedMetricResult: typing.Optional[
        vertexai._genai.types.common.RubricBasedMetricResult
    ] = None,
    metricResults: typing.Optional[
        list[vertexai._genai.types.common.MetricResult]
    ] = None,
    bleuResults: typing.Optional[vertexai._genai.types.common.BleuResults] = None,
    cometResult: typing.Optional[vertexai._genai.types.common.CometResult] = None,
    exactMatchResults: typing.Optional[
        vertexai._genai.types.common.ExactMatchResults
    ] = None,
    metricxResult: typing.Optional[vertexai._genai.types.common.MetricxResult] = None,
    pairwiseMetricResult: typing.Optional[
        vertexai._genai.types.common.PairwiseMetricResult
    ] = None,
    pointwiseMetricResult: typing.Optional[
        vertexai._genai.types.common.PointwiseMetricResult
    ] = None,
    rougeResults: typing.Optional[vertexai._genai.types.common.RougeResults] = None,
    toolCallValidResults: typing.Optional[
        vertexai._genai.types.common.ToolCallValidResults
    ] = None,
    toolNameMatchResults: typing.Optional[
        vertexai._genai.types.common.ToolNameMatchResults
    ] = None,
    toolParameterKeyMatchResults: typing.Optional[
        vertexai._genai.types.common.ToolParameterKeyMatchResults
    ] = None,
    toolParameterKvMatchResults: typing.Optional[
        vertexai._genai.types.common.ToolParameterKVMatchResults
    ] = None
)

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.