public sealed class EvaluateInstancesRequest : IMessage<EvaluateInstancesRequest>, IEquatable<EvaluateInstancesRequest>, IDeepCloneable<EvaluateInstancesRequest>, IBufferMessage, IMessageReference documentation and code samples for the Vertex AI v1beta1 API class EvaluateInstancesRequest.
Request message for EvaluationService.EvaluateInstances.
Implements
IMessageEvaluateInstancesRequest, IEquatableEvaluateInstancesRequest, IDeepCloneableEvaluateInstancesRequest, IBufferMessage, IMessageNamespace
Google.Cloud.AIPlatform.V1Beta1Assembly
Google.Cloud.AIPlatform.V1Beta1.dll
Constructors
EvaluateInstancesRequest()
public EvaluateInstancesRequest()EvaluateInstancesRequest(EvaluateInstancesRequest)
public EvaluateInstancesRequest(EvaluateInstancesRequest other)| Parameter | |
|---|---|
| Name | Description |
other |
EvaluateInstancesRequest |
Properties
AutoraterConfig
public AutoraterConfig AutoraterConfig { get; set; }Optional. Autorater config used for evaluation.
| Property Value | |
|---|---|
| Type | Description |
AutoraterConfig |
|
BleuInput
public BleuInput BleuInput { get; set; }Instances and metric spec for bleu metric.
| Property Value | |
|---|---|
| Type | Description |
BleuInput |
|
CoherenceInput
public CoherenceInput CoherenceInput { get; set; }Input for coherence metric.
| Property Value | |
|---|---|
| Type | Description |
CoherenceInput |
|
CometInput
public CometInput CometInput { get; set; }Translation metrics. Input for Comet metric.
| Property Value | |
|---|---|
| Type | Description |
CometInput |
|
ExactMatchInput
public ExactMatchInput ExactMatchInput { get; set; }Auto metric instances. Instances and metric spec for exact match metric.
| Property Value | |
|---|---|
| Type | Description |
ExactMatchInput |
|
FluencyInput
public FluencyInput FluencyInput { get; set; }LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.
| Property Value | |
|---|---|
| Type | Description |
FluencyInput |
|
FulfillmentInput
public FulfillmentInput FulfillmentInput { get; set; }Input for fulfillment metric.
| Property Value | |
|---|---|
| Type | Description |
FulfillmentInput |
|
GroundednessInput
public GroundednessInput GroundednessInput { get; set; }Input for groundedness metric.
| Property Value | |
|---|---|
| Type | Description |
GroundednessInput |
|
Location
public string Location { get; set; }Required. The resource name of the Location to evaluate the instances.
Format: projects/{project}/locations/{location}
| Property Value | |
|---|---|
| Type | Description |
string |
|
LocationAsLocationName
public LocationName LocationAsLocationName { get; set; }LocationName-typed view over the Location resource name property.
| Property Value | |
|---|---|
| Type | Description |
LocationName |
|
MetricInputsCase
public EvaluateInstancesRequest.MetricInputsOneofCase MetricInputsCase { get; }| Property Value | |
|---|---|
| Type | Description |
EvaluateInstancesRequestMetricInputsOneofCase |
|
MetricxInput
public MetricxInput MetricxInput { get; set; }Input for Metricx metric.
| Property Value | |
|---|---|
| Type | Description |
MetricxInput |
|
PairwiseMetricInput
public PairwiseMetricInput PairwiseMetricInput { get; set; }Input for pairwise metric.
| Property Value | |
|---|---|
| Type | Description |
PairwiseMetricInput |
|
PairwiseQuestionAnsweringQualityInput
public PairwiseQuestionAnsweringQualityInput PairwiseQuestionAnsweringQualityInput { get; set; }Input for pairwise question answering quality metric.
| Property Value | |
|---|---|
| Type | Description |
PairwiseQuestionAnsweringQualityInput |
|
PairwiseSummarizationQualityInput
public PairwiseSummarizationQualityInput PairwiseSummarizationQualityInput { get; set; }Input for pairwise summarization quality metric.
| Property Value | |
|---|---|
| Type | Description |
PairwiseSummarizationQualityInput |
|
PointwiseMetricInput
public PointwiseMetricInput PointwiseMetricInput { get; set; }Input for pointwise metric.
| Property Value | |
|---|---|
| Type | Description |
PointwiseMetricInput |
|
QuestionAnsweringCorrectnessInput
public QuestionAnsweringCorrectnessInput QuestionAnsweringCorrectnessInput { get; set; }Input for question answering correctness metric.
| Property Value | |
|---|---|
| Type | Description |
QuestionAnsweringCorrectnessInput |
|
QuestionAnsweringHelpfulnessInput
public QuestionAnsweringHelpfulnessInput QuestionAnsweringHelpfulnessInput { get; set; }Input for question answering helpfulness metric.
| Property Value | |
|---|---|
| Type | Description |
QuestionAnsweringHelpfulnessInput |
|
QuestionAnsweringQualityInput
public QuestionAnsweringQualityInput QuestionAnsweringQualityInput { get; set; }Input for question answering quality metric.
| Property Value | |
|---|---|
| Type | Description |
QuestionAnsweringQualityInput |
|
QuestionAnsweringRelevanceInput
public QuestionAnsweringRelevanceInput QuestionAnsweringRelevanceInput { get; set; }Input for question answering relevance metric.
| Property Value | |
|---|---|
| Type | Description |
QuestionAnsweringRelevanceInput |
|
RougeInput
public RougeInput RougeInput { get; set; }Instances and metric spec for rouge metric.
| Property Value | |
|---|---|
| Type | Description |
RougeInput |
|
RubricBasedInstructionFollowingInput
public RubricBasedInstructionFollowingInput RubricBasedInstructionFollowingInput { get; set; }Rubric Based Instruction Following metric.
| Property Value | |
|---|---|
| Type | Description |
RubricBasedInstructionFollowingInput |
|
SafetyInput
public SafetyInput SafetyInput { get; set; }Input for safety metric.
| Property Value | |
|---|---|
| Type | Description |
SafetyInput |
|
SummarizationHelpfulnessInput
public SummarizationHelpfulnessInput SummarizationHelpfulnessInput { get; set; }Input for summarization helpfulness metric.
| Property Value | |
|---|---|
| Type | Description |
SummarizationHelpfulnessInput |
|
SummarizationQualityInput
public SummarizationQualityInput SummarizationQualityInput { get; set; }Input for summarization quality metric.
| Property Value | |
|---|---|
| Type | Description |
SummarizationQualityInput |
|
SummarizationVerbosityInput
public SummarizationVerbosityInput SummarizationVerbosityInput { get; set; }Input for summarization verbosity metric.
| Property Value | |
|---|---|
| Type | Description |
SummarizationVerbosityInput |
|
ToolCallValidInput
public ToolCallValidInput ToolCallValidInput { get; set; }Tool call metric instances. Input for tool call valid metric.
| Property Value | |
|---|---|
| Type | Description |
ToolCallValidInput |
|
ToolNameMatchInput
public ToolNameMatchInput ToolNameMatchInput { get; set; }Input for tool name match metric.
| Property Value | |
|---|---|
| Type | Description |
ToolNameMatchInput |
|
ToolParameterKeyMatchInput
public ToolParameterKeyMatchInput ToolParameterKeyMatchInput { get; set; }Input for tool parameter key match metric.
| Property Value | |
|---|---|
| Type | Description |
ToolParameterKeyMatchInput |
|
ToolParameterKvMatchInput
public ToolParameterKVMatchInput ToolParameterKvMatchInput { get; set; }Input for tool parameter key value match metric.
| Property Value | |
|---|---|
| Type | Description |
ToolParameterKVMatchInput |
|
TrajectoryAnyOrderMatchInput
public TrajectoryAnyOrderMatchInput TrajectoryAnyOrderMatchInput { get; set; }Input for trajectory match any order metric.
| Property Value | |
|---|---|
| Type | Description |
TrajectoryAnyOrderMatchInput |
|
TrajectoryExactMatchInput
public TrajectoryExactMatchInput TrajectoryExactMatchInput { get; set; }Input for trajectory exact match metric.
| Property Value | |
|---|---|
| Type | Description |
TrajectoryExactMatchInput |
|
TrajectoryInOrderMatchInput
public TrajectoryInOrderMatchInput TrajectoryInOrderMatchInput { get; set; }Input for trajectory in order match metric.
| Property Value | |
|---|---|
| Type | Description |
TrajectoryInOrderMatchInput |
|
TrajectoryPrecisionInput
public TrajectoryPrecisionInput TrajectoryPrecisionInput { get; set; }Input for trajectory precision metric.
| Property Value | |
|---|---|
| Type | Description |
TrajectoryPrecisionInput |
|
TrajectoryRecallInput
public TrajectoryRecallInput TrajectoryRecallInput { get; set; }Input for trajectory recall metric.
| Property Value | |
|---|---|
| Type | Description |
TrajectoryRecallInput |
|
TrajectorySingleToolUseInput
public TrajectorySingleToolUseInput TrajectorySingleToolUseInput { get; set; }Input for trajectory single tool use metric.
| Property Value | |
|---|---|
| Type | Description |
TrajectorySingleToolUseInput |
|