public static interface EvaluationServiceGrpc.AsyncServiceVertex AI Online Evaluation Service.
Methods
evaluateDataset(EvaluateDatasetRequest request, StreamObserver<Operation> responseObserver)
public default void evaluateDataset(EvaluateDatasetRequest request, StreamObserver<Operation> responseObserver)Evaluates a dataset based on a set of given metrics.
| Parameters | |
|---|---|
| Name | Description |
request |
EvaluateDatasetRequest |
responseObserver |
io.grpc.stub.StreamObserver<Operation> |
evaluateInstances(EvaluateInstancesRequest request, StreamObserver<EvaluateInstancesResponse> responseObserver)
public default void evaluateInstances(EvaluateInstancesRequest request, StreamObserver<EvaluateInstancesResponse> responseObserver)Evaluates instances based on a given metric.
| Parameters | |
|---|---|
| Name | Description |
request |
EvaluateInstancesRequest |
responseObserver |
io.grpc.stub.StreamObserver<EvaluateInstancesResponse> |
generateInstanceRubrics(GenerateInstanceRubricsRequest request, StreamObserver<GenerateInstanceRubricsResponse> responseObserver)
public default void generateInstanceRubrics(GenerateInstanceRubricsRequest request, StreamObserver<GenerateInstanceRubricsResponse> responseObserver)Generates rubrics for a given prompt. A rubric represents a single testable criterion for evaluation. One input prompt could have multiple rubrics This RPC allows users to get suggested rubrics based on provided prompt, which can then be reviewed and used for subsequent evaluations.
| Parameters | |
|---|---|
| Name | Description |
request |
GenerateInstanceRubricsRequest |
responseObserver |
io.grpc.stub.StreamObserver<GenerateInstanceRubricsResponse> |