Interface ModelServerInfoOrBuilder (0.1.0)

public interface ModelServerInfoOrBuilder extends MessageOrBuilder

Implements

MessageOrBuilder

Methods

getModel()

public abstract String getModel()

Required. The model. Open-source models follow the Huggingface Hub owner/model_name format. Use GkeInferenceQuickstart.FetchModels to find available models.

string model = 1 [(.google.api.field_behavior) = REQUIRED];

Returns
Type	Description
String	The model.

getModelBytes()

public abstract ByteString getModelBytes()

Required. The model. Open-source models follow the Huggingface Hub owner/model_name format. Use GkeInferenceQuickstart.FetchModels to find available models.

string model = 1 [(.google.api.field_behavior) = REQUIRED];

Returns
Type	Description
ByteString	The bytes for model.

getModelServer()

public abstract String getModelServer()

Required. The model server. Open-source model servers use simplified, lowercase names (e.g., vllm). Use GkeInferenceQuickstart.FetchModelServers to find available servers.

string model_server = 2 [(.google.api.field_behavior) = REQUIRED];

Returns
Type	Description
String	The modelServer.

getModelServerBytes()

public abstract ByteString getModelServerBytes()

Required. The model server. Open-source model servers use simplified, lowercase names (e.g., vllm). Use GkeInferenceQuickstart.FetchModelServers to find available servers.

string model_server = 2 [(.google.api.field_behavior) = REQUIRED];

Returns
Type	Description
ByteString	The bytes for modelServer.

getModelServerVersion()

public abstract String getModelServerVersion()

Optional. The model server version. Use GkeInferenceQuickstart.FetchModelServerVersions to find available versions. If not provided, the latest available version is used.

string model_server_version = 3 [(.google.api.field_behavior) = OPTIONAL];

Returns
Type	Description
String	The modelServerVersion.

getModelServerVersionBytes()

public abstract ByteString getModelServerVersionBytes()

Optional. The model server version. Use GkeInferenceQuickstart.FetchModelServerVersions to find available versions. If not provided, the latest available version is used.

string model_server_version = 3 [(.google.api.field_behavior) = OPTIONAL];

Returns
Type	Description
ByteString	The bytes for modelServerVersion.