Vertex AI v1beta1 API - Class EvaluationService.EvaluationServiceBase (1.0.0-beta78)

1.0.0-beta78 (latest) 1.0.0-beta77

[BindServiceMethod(typeof(EvaluationService), "BindService")]
public abstract class EvaluationService.EvaluationServiceBase

Reference documentation and code samples for the Vertex AI v1beta1 API class EvaluationService.EvaluationServiceBase.

Base class for server-side implementations of EvaluationService

Inheritance

object > EvaluationService.EvaluationServiceBase

Inherited Members

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ToString()

Namespace

Google.Cloud.AIPlatform.V1Beta1

Assembly

Google.Cloud.AIPlatform.V1Beta1.dll

Methods

EvaluateDataset(EvaluateDatasetRequest, ServerCallContext)

public virtual Task<Operation> EvaluateDataset(EvaluateDatasetRequest request, ServerCallContext context)

Evaluates a dataset based on a set of given metrics.

Parameters
Name	Description
request	EvaluateDatasetRequest The request received from the client.
context	ServerCallContext The context of the server-side call handler being invoked.

Returns
Type	Description
TaskOperation	The response to send back to the client (wrapped by a task).

EvaluateInstances(EvaluateInstancesRequest, ServerCallContext)

public virtual Task<EvaluateInstancesResponse> EvaluateInstances(EvaluateInstancesRequest request, ServerCallContext context)

Evaluates instances based on a given metric.

Parameters
Name	Description
request	EvaluateInstancesRequest The request received from the client.
context	ServerCallContext The context of the server-side call handler being invoked.

Returns
Type	Description
TaskEvaluateInstancesResponse	The response to send back to the client (wrapped by a task).

GenerateInstanceRubrics(GenerateInstanceRubricsRequest, ServerCallContext)

public virtual Task<GenerateInstanceRubricsResponse> GenerateInstanceRubrics(GenerateInstanceRubricsRequest request, ServerCallContext context)

Generates rubrics for a given prompt. A rubric represents a single testable criterion for evaluation. One input prompt could have multiple rubrics This RPC allows users to get suggested rubrics based on provided prompt, which can then be reviewed and used for subsequent evaluations.

Parameters
Name	Description
request	GenerateInstanceRubricsRequest The request received from the client.
context	ServerCallContext The context of the server-side call handler being invoked.

Returns
Type	Description
TaskGenerateInstanceRubricsResponse	The response to send back to the client (wrapped by a task).