Vertex AI V1 API - Class Google::Cloud::AIPlatform::V1::AutoraterConfig (v1.40.0)

1.40.0 (latest) 1.39.0 1.38.0 1.37.0 1.36.0 1.35.0 1.34.0 1.33.0 1.32.0 1.31.0 1.30.1 1.29.0 1.28.0 1.27.0 1.26.0 1.25.0 1.24.0 1.23.1 1.22.0 1.21.0 1.20.0 1.19.0 1.18.0 1.17.0 1.16.0 1.15.0 1.14.0 1.13.0 1.12.0 1.11.0 1.10.0 1.9.0 1.8.0 1.7.0 1.6.0 1.5.0 1.4.0 1.3.0 1.2.0 1.1.0 1.0.0 0.64.0 0.63.0 0.62.0 0.61.0 0.60.0 0.59.0 0.58.0 0.57.0 0.56.0 0.55.0 0.54.0 0.53.0 0.52.0 0.51.0 0.50.0 0.49.0 0.48.0 0.47.0 0.46.0 0.45.0 0.44.0 0.43.0 0.42.0 0.41.0 0.40.0 0.39.0 0.38.0 0.37.0 0.36.0 0.35.0 0.34.0 0.33.0 0.32.0 0.31.0 0.30.0 0.29.0 0.28.0 0.27.0 0.26.0 0.25.0 0.24.0 0.23.0 0.22.0 0.21.0 0.20.0 0.19.0 0.18.0 0.17.0 0.16.0 0.15.0 0.14.0 0.13.0 0.12.0 0.11.0 0.10.0 0.9.1 0.8.0 0.7.0 0.6.0 0.5.0 0.4.0 0.3.0 0.2.0 0.1.0

Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::AutoraterConfig.

The configs for autorater. This is applicable to both EvaluateInstances and EvaluateDataset.

Inherits

• Object

Extended By

• Google::Protobuf::MessageExts::ClassMethods

Includes

• Google::Protobuf::MessageExts

Methods

#autorater_model

def autorater_model() -> ::String

Returns

• (::String) — Optional. The fully qualified name of the publisher model or tuned autorater endpoint to use.

  Publisher model format: projects/{project}/locations/{location}/publishers/*/models/*

  Tuned model endpoint format: projects/{project}/locations/{location}/endpoints/{endpoint}

#autorater_model=

def autorater_model=(value) -> ::String

Parameter

• value (::String) — Optional. The fully qualified name of the publisher model or tuned autorater endpoint to use.

  Publisher model format: projects/{project}/locations/{location}/publishers/*/models/*

  Tuned model endpoint format: projects/{project}/locations/{location}/endpoints/{endpoint}

Returns

• (::String) — Optional. The fully qualified name of the publisher model or tuned autorater endpoint to use.

  Publisher model format: projects/{project}/locations/{location}/publishers/*/models/*

  Tuned model endpoint format: projects/{project}/locations/{location}/endpoints/{endpoint}

#flip_enabled

def flip_enabled() -> ::Boolean

Returns

• (::Boolean) — Optional. Default is true. Whether to flip the candidate and baseline responses. This is only applicable to the pairwise metric. If enabled, also provide PairwiseMetricSpec.candidate_response_field_name and PairwiseMetricSpec.baseline_response_field_name. When rendering PairwiseMetricSpec.metric_prompt_template, the candidate and baseline fields will be flipped for half of the samples to reduce bias.

#flip_enabled=

def flip_enabled=(value) -> ::Boolean

Parameter

• value (::Boolean) — Optional. Default is true. Whether to flip the candidate and baseline responses. This is only applicable to the pairwise metric. If enabled, also provide PairwiseMetricSpec.candidate_response_field_name and PairwiseMetricSpec.baseline_response_field_name. When rendering PairwiseMetricSpec.metric_prompt_template, the candidate and baseline fields will be flipped for half of the samples to reduce bias.

Returns

• (::Boolean) — Optional. Default is true. Whether to flip the candidate and baseline responses. This is only applicable to the pairwise metric. If enabled, also provide PairwiseMetricSpec.candidate_response_field_name and PairwiseMetricSpec.baseline_response_field_name. When rendering PairwiseMetricSpec.metric_prompt_template, the candidate and baseline fields will be flipped for half of the samples to reduce bias.

#generation_config

def generation_config() -> ::Google::Cloud::AIPlatform::V1::GenerationConfig

Returns

• (::Google::Cloud::AIPlatform::V1::GenerationConfig) — Optional. Configuration options for model generation and outputs.

#generation_config=

def generation_config=(value) -> ::Google::Cloud::AIPlatform::V1::GenerationConfig

Parameter

• value (::Google::Cloud::AIPlatform::V1::GenerationConfig) — Optional. Configuration options for model generation and outputs.

Returns

• (::Google::Cloud::AIPlatform::V1::GenerationConfig) — Optional. Configuration options for model generation and outputs.

#sampling_count

def sampling_count() -> ::Integer

Returns

• (::Integer) — Optional. Number of samples for each instance in the dataset. If not specified, the default is 4. Minimum value is 1, maximum value is 32.

#sampling_count=

def sampling_count=(value) -> ::Integer

Parameter

• value (::Integer) — Optional. Number of samples for each instance in the dataset. If not specified, the default is 4. Minimum value is 1, maximum value is 32.

Returns

• (::Integer) — Optional. Number of samples for each instance in the dataset. If not specified, the default is 4. Minimum value is 1, maximum value is 32.