Response message for EvaluationAnalyticsService.GenerateLossClusters.
The timestamp when this analysis was completed.
Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: "2014-10-02T15:01:23Z", "2014-10-02T15:01:23.045123456Z" or "2014-10-02T15:01:23+05:30".
The analysis results, one per config provided in the request.
| JSON representation |
|---|
{
"analysisTime": string,
"results": [
{
object ( |
LossAnalysisResult
The top-level result for loss analysis, stored within an EvalSet.
The configuration used to generate this analysis.
The timestamp when this analysis was performed.
Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: "2014-10-02T15:01:23Z", "2014-10-02T15:01:23.045123456Z" or "2014-10-02T15:01:23+05:30".
The list of identified loss clusters.
| JSON representation |
|---|
{ "config": { object ( |
LossCluster
Represents a semantic grouping of failures (e.g., "Hallucination of Action").
clusterIdstring
Unique identifier for the loss cluster within the scope of the analysis result.
The structured definition of the loss taxonomy for this cluster.
itemCountinteger
The total number of EvaluationItems falling into this cluster.
A list of examples that belong to this cluster. This links the cluster back to the specific EvaluationItems and Rubrics.
| JSON representation |
|---|
{ "clusterId": string, "taxonomyEntry": { object ( |
LossTaxonomyEntry
Defines a specific entry in the loss pattern taxonomy.
l1Categorystring
The primary category of the loss (e.g., "Hallucination", "Tool Calling"). This field is typically required.
l2Categorystring
The secondary category of the loss (e.g., "Hallucination of Action", "Incorrect Tool Selection").
descriptionstring
A detailed description of this loss pattern. Example: "The agent verbally confirms an action without executing the tool."
| JSON representation |
|---|
{ "l1Category": string, "l2Category": string, "description": string } |
LossExample
Represents a specific example of a loss pattern.
The specific rubric(s) that failed and caused this example to be classified here. An example might fail multiple rubrics, but only specific ones trigger this loss pattern.
sourceUnion type
source can be only one of the following:evaluationItemstring
Reference to the persisted EvalItem resource name. Format: projects/.../locations/.../evaluationItems/{itemId} Used when analysis is run on an EvalSet.
| JSON representation |
|---|
{
"failedRubrics": [
{
object ( |