AggregatedMetrics

Aggregated metrics for an evaluation or evaluation dataset.

JSON representation 
{
  "metricsByAppVersion": [
    {
      object (AggregatedMetrics.MetricsByAppVersion)
    }
  ]
}
Fields
metricsByAppVersion[]

object (AggregatedMetrics.MetricsByAppVersion)

Output only. Aggregated metrics, grouped by app version ID.

AggregatedMetrics.MetricsByAppVersion

Metrics aggregated per app version.

JSON representation 
{
  "appVersionId": string,
  "toolMetrics": [
    {
      object (AggregatedMetrics.ToolMetrics)
    }
  ],
  "semanticSimilarityMetrics": [
    {
      object (AggregatedMetrics.SemanticSimilarityMetrics)
    }
  ],
  "hallucinationMetrics": [
    {
      object (AggregatedMetrics.HallucinationMetrics)
    }
  ],
  "toolCallLatencyMetrics": [
    {
      object (AggregatedMetrics.ToolCallLatencyMetrics)
    }
  ],
  "turnLatencyMetrics": [
    {
      object (AggregatedMetrics.TurnLatencyMetrics)
    }
  ],
  "passCount": integer,
  "failCount": integer,
  "metricsByTurn": [
    {
      object (AggregatedMetrics.MetricsByTurn)
    }
  ]
}
Fields
appVersionId

string

Output only. The app version ID.
toolMetrics[]

object (AggregatedMetrics.ToolMetrics)

Output only. Metrics for each tool within this app version.
semanticSimilarityMetrics[]

object (AggregatedMetrics.SemanticSimilarityMetrics)

Output only. Metrics for semantic similarity within this app version.
hallucinationMetrics[]

object (AggregatedMetrics.HallucinationMetrics)

Output only. Metrics for hallucination within this app version.
toolCallLatencyMetrics[]

object (AggregatedMetrics.ToolCallLatencyMetrics)

Output only. Metrics for tool call latency within this app version.
turnLatencyMetrics[]

object (AggregatedMetrics.TurnLatencyMetrics)

Output only. Metrics for turn latency within this app version.
passCount

integer

Output only. The number of times the evaluation passed.
failCount

integer

Output only. The number of times the evaluation failed.
metricsByTurn[]

object (AggregatedMetrics.MetricsByTurn)

Output only. Metrics aggregated per turn within this app version.

AggregatedMetrics.ToolMetrics

Metrics for a single tool.

JSON representation 
{
  "tool": string,
  "passCount": integer,
  "failCount": integer
}
Fields
tool

string

Output only. The name of the tool.
passCount

integer

Output only. The number of times the tool passed.
failCount

integer

Output only. The number of times the tool failed.

AggregatedMetrics.SemanticSimilarityMetrics

Metrics for semantic similarity results.

JSON representation 
{
  "score": number
}
Fields
score

number

Output only. The average semantic similarity score (0-4).

AggregatedMetrics.HallucinationMetrics

Metrics for hallucination results.

JSON representation 
{
  "score": number
}
Fields
score

number

Output only. The average hallucination score (0 to 1).

AggregatedMetrics.ToolCallLatencyMetrics

Metrics for tool call latency.

JSON representation 
{
  "tool": string,
  "averageLatency": string
}
Fields
tool

string

Output only. The name of the tool.
averageLatency

string (Duration format)

Output only. The average latency of the tool calls.

A duration in seconds with up to nine fractional digits, ending with 's'. Example: "3.5s".

AggregatedMetrics.TurnLatencyMetrics

Metrics for turn latency.

JSON representation 
{
  "averageLatency": string
}
Fields
averageLatency

string (Duration format)

Output only. The average latency of the turns.

A duration in seconds with up to nine fractional digits, ending with 's'. Example: "3.5s".

AggregatedMetrics.MetricsByTurn

Metrics aggregated per turn.

JSON representation 
{
  "turnIndex": integer,
  "toolMetrics": [
    {
      object (AggregatedMetrics.ToolMetrics)
    }
  ],
  "semanticSimilarityMetrics": [
    {
      object (AggregatedMetrics.SemanticSimilarityMetrics)
    }
  ],
  "hallucinationMetrics": [
    {
      object (AggregatedMetrics.HallucinationMetrics)
    }
  ],
  "toolCallLatencyMetrics": [
    {
      object (AggregatedMetrics.ToolCallLatencyMetrics)
    }
  ],
  "turnLatencyMetrics": [
    {
      object (AggregatedMetrics.TurnLatencyMetrics)
    }
  ]
}
Fields
turnIndex

integer

Output only. The turn index (0-based).
toolMetrics[]

object (AggregatedMetrics.ToolMetrics)

Output only. Metrics for each tool within this turn.
semanticSimilarityMetrics[]

object (AggregatedMetrics.SemanticSimilarityMetrics)

Output only. Metrics for semantic similarity within this turn.
hallucinationMetrics[]

object (AggregatedMetrics.HallucinationMetrics)

Output only. Metrics for hallucination within this turn.
toolCallLatencyMetrics[]

object (AggregatedMetrics.ToolCallLatencyMetrics)

Output only. Metrics for tool call latency within this turn.
turnLatencyMetrics[]

object (AggregatedMetrics.TurnLatencyMetrics)

Output only. Metrics for turn latency within this turn.