Class GkeInferenceQuickstartGrpc (0.1.0)

public final class GkeInferenceQuickstartGrpc

GKE Inference Quickstart (GIQ) service provides profiles with performance metrics for popular models and model servers across multiple accelerators. These profiles help generate optimized best practices for running inference on GKE.

Inheritance

java.lang.Object > GkeInferenceQuickstartGrpc

Static Fields

SERVICE_NAME

public static final String SERVICE_NAME
Field Value
Type Description
String

Static Methods

bindService(GkeInferenceQuickstartGrpc.AsyncService service)

public static final ServerServiceDefinition bindService(GkeInferenceQuickstartGrpc.AsyncService service)
Parameter
Name Description
service GkeInferenceQuickstartGrpc.AsyncService
Returns
Type Description
io.grpc.ServerServiceDefinition

getFetchBenchmarkingDataMethod()

public static MethodDescriptor<FetchBenchmarkingDataRequest,FetchBenchmarkingDataResponse> getFetchBenchmarkingDataMethod()
Returns
Type Description
io.grpc.MethodDescriptor<FetchBenchmarkingDataRequest,FetchBenchmarkingDataResponse>

getFetchModelServerVersionsMethod()

public static MethodDescriptor<FetchModelServerVersionsRequest,FetchModelServerVersionsResponse> getFetchModelServerVersionsMethod()
Returns
Type Description
io.grpc.MethodDescriptor<FetchModelServerVersionsRequest,FetchModelServerVersionsResponse>

getFetchModelServersMethod()

public static MethodDescriptor<FetchModelServersRequest,FetchModelServersResponse> getFetchModelServersMethod()
Returns
Type Description
io.grpc.MethodDescriptor<FetchModelServersRequest,FetchModelServersResponse>

getFetchModelsMethod()

public static MethodDescriptor<FetchModelsRequest,FetchModelsResponse> getFetchModelsMethod()
Returns
Type Description
io.grpc.MethodDescriptor<FetchModelsRequest,FetchModelsResponse>

getFetchProfilesMethod()

public static MethodDescriptor<FetchProfilesRequest,FetchProfilesResponse> getFetchProfilesMethod()
Returns
Type Description
io.grpc.MethodDescriptor<FetchProfilesRequest,FetchProfilesResponse>

getGenerateOptimizedManifestMethod()

public static MethodDescriptor<GenerateOptimizedManifestRequest,GenerateOptimizedManifestResponse> getGenerateOptimizedManifestMethod()
Returns
Type Description
io.grpc.MethodDescriptor<GenerateOptimizedManifestRequest,GenerateOptimizedManifestResponse>

getServiceDescriptor()

public static ServiceDescriptor getServiceDescriptor()
Returns
Type Description
io.grpc.ServiceDescriptor

newBlockingStub(Channel channel)

public static GkeInferenceQuickstartGrpc.GkeInferenceQuickstartBlockingStub newBlockingStub(Channel channel)

Creates a new blocking-style stub that supports unary and streaming output calls on the service

Parameter
Name Description
channel io.grpc.Channel
Returns
Type Description
GkeInferenceQuickstartGrpc.GkeInferenceQuickstartBlockingStub

newBlockingV2Stub(Channel channel)

public static GkeInferenceQuickstartGrpc.GkeInferenceQuickstartBlockingV2Stub newBlockingV2Stub(Channel channel)

Creates a new blocking-style stub that supports all types of calls on the service

Parameter
Name Description
channel io.grpc.Channel
Returns
Type Description
GkeInferenceQuickstartGrpc.GkeInferenceQuickstartBlockingV2Stub

newFutureStub(Channel channel)

public static GkeInferenceQuickstartGrpc.GkeInferenceQuickstartFutureStub newFutureStub(Channel channel)

Creates a new ListenableFuture-style stub that supports unary calls on the service

Parameter
Name Description
channel io.grpc.Channel
Returns
Type Description
GkeInferenceQuickstartGrpc.GkeInferenceQuickstartFutureStub

newStub(Channel channel)

public static GkeInferenceQuickstartGrpc.GkeInferenceQuickstartStub newStub(Channel channel)

Creates a new async stub that supports all call types for the service

Parameter
Name Description
channel io.grpc.Channel
Returns
Type Description
GkeInferenceQuickstartGrpc.GkeInferenceQuickstartStub