Resource: EvaluationExpectation
An evaluation expectation represents a specific criteria to evaluate against.
| JSON representation |
|---|
{ "name": string, "displayName": string, "tags": [ string ], "createTime": string, "updateTime": string, "etag": string, // Union field |
| Fields | |
|---|---|
name |
Identifier. The unique identifier of this evaluation expectation. Format: |
displayName |
Required. User-defined display name. Must be unique within the app. |
tags[] |
Optional. User-defined tags for expectations. Can be used to filter expectations. |
createTime |
Output only. Timestamp when the evaluation expectation was created. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
updateTime |
Output only. Timestamp when the evaluation expectation was last updated. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
etag |
Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
Union field criteria. The definition of the criteria used for evaluation. criteria can be only one of the following: |
|
llmCriteria |
Optional. Evaluation criteria based on an LLM prompt. |
EvaluationExpectation.LlmCriteria
Configuration for LLM-based evaluation criteria.
| JSON representation |
|---|
{ "prompt": string } |
| Fields | |
|---|---|
prompt |
Required. The prompt/instructions provided to the LLM judge. |
Methods |
|
|---|---|
|
Creates an evaluation expectation. |
|
Deletes an evaluation expectation. |
|
Gets details of the specified evaluation expectation. |
|
Lists all evaluation expectations in the given app. |
|
Updates an evaluation expectation. |