REST Resource: projects.locations.apps.evaluationExpectations

Resource: EvaluationExpectation

An evaluation expectation represents a specific criteria to evaluate against.

JSON representation
{
  "name": string,
  "displayName": string,
  "tags": [
    string
  ],
  "createTime": string,
  "updateTime": string,
  "etag": string,

  // Union field criteria can be only one of the following:
  "llmCriteria": {
    object (EvaluationExpectation.LlmCriteria)
  }
  // End of list of possible types for union field criteria.
}
Fields
name

string

Identifier. The unique identifier of this evaluation expectation. Format: projects/{project}/locations/{location}/apps/{app}/evaluationExpectations/{evaluationExpectation}

displayName

string

Required. User-defined display name. Must be unique within the app.

tags[]

string

Optional. User-defined tags for expectations. Can be used to filter expectations.

createTime

string (Timestamp format)

Output only. Timestamp when the evaluation expectation was created.

Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: "2014-10-02T15:01:23Z", "2014-10-02T15:01:23.045123456Z" or "2014-10-02T15:01:23+05:30".

updateTime

string (Timestamp format)

Output only. Timestamp when the evaluation expectation was last updated.

Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: "2014-10-02T15:01:23Z", "2014-10-02T15:01:23.045123456Z" or "2014-10-02T15:01:23+05:30".

etag

string

Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes.

Union field criteria. The definition of the criteria used for evaluation. criteria can be only one of the following:
llmCriteria

object (EvaluationExpectation.LlmCriteria)

Optional. Evaluation criteria based on an LLM prompt.

EvaluationExpectation.LlmCriteria

Configuration for LLM-based evaluation criteria.

JSON representation
{
  "prompt": string
}
Fields
prompt

string

Required. The prompt/instructions provided to the LLM judge.

Methods

create

Creates an evaluation expectation.

delete

Deletes an evaluation expectation.

get

Gets details of the specified evaluation expectation.

list

Lists all evaluation expectations in the given app.

patch

Updates an evaluation expectation.