Class EvaluationServiceGrpc.EvaluationServiceFutureStub (3.100.0)

public static final class EvaluationServiceGrpc.EvaluationServiceFutureStub extends AbstractFutureStub<EvaluationServiceGrpc.EvaluationServiceFutureStub>

A stub to allow clients to do ListenableFuture-style rpc calls to service EvaluationService.

Vertex AI Online Evaluation Service.

Inheritance

java.lang.Object > io.grpc.stub.AbstractStub > io.grpc.stub.AbstractFutureStub > EvaluationServiceGrpc.EvaluationServiceFutureStub

Methods

build(Channel channel, CallOptions callOptions)

protected EvaluationServiceGrpc.EvaluationServiceFutureStub build(Channel channel, CallOptions callOptions)
Parameters
Name Description
channel io.grpc.Channel
callOptions io.grpc.CallOptions
Returns
Type Description
EvaluationServiceGrpc.EvaluationServiceFutureStub
Overrides
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)

evaluateDataset(EvaluateDatasetRequest request)

public ListenableFuture<Operation> evaluateDataset(EvaluateDatasetRequest request)

Evaluates a dataset based on a set of given metrics.

Parameter
Name Description
request EvaluateDatasetRequest
Returns
Type Description
com.google.common.util.concurrent.ListenableFuture<Operation>

evaluateInstances(EvaluateInstancesRequest request)

public ListenableFuture<EvaluateInstancesResponse> evaluateInstances(EvaluateInstancesRequest request)

Evaluates instances based on a given metric.

Parameter
Name Description
request EvaluateInstancesRequest
Returns
Type Description
com.google.common.util.concurrent.ListenableFuture<EvaluateInstancesResponse>

generateInstanceRubrics(GenerateInstanceRubricsRequest request)

public ListenableFuture<GenerateInstanceRubricsResponse> generateInstanceRubrics(GenerateInstanceRubricsRequest request)

Generates rubrics for a given prompt. A rubric represents a single testable criterion for evaluation. One input prompt could have multiple rubrics This RPC allows users to get suggested rubrics based on provided prompt, which can then be reviewed and used for subsequent evaluations.

Parameter
Name Description
request GenerateInstanceRubricsRequest
Returns
Type Description
com.google.common.util.concurrent.ListenableFuture<GenerateInstanceRubricsResponse>