GKE Recommender v1 API - Class ModelServerInfo (1.0.0-beta01) 

public sealed class ModelServerInfo : IMessage<ModelServerInfo>, IEquatable<ModelServerInfo>, IDeepCloneable<ModelServerInfo>, IBufferMessage, IMessage

Reference documentation and code samples for the GKE Recommender v1 API class ModelServerInfo.

Model server information gives. Valid model server info combinations can be found using [GkeInferenceQuickstart.FetchProfiles][google.cloud.gkerecommender.v1.GkeInferenceQuickstart.FetchProfiles].

Inheritance

object > ModelServerInfo

Namespace

Google.Cloud.GkeRecommender.V1

Assembly

Google.Cloud.GkeRecommender.V1.dll

Constructors

ModelServerInfo()

public ModelServerInfo()

ModelServerInfo(ModelServerInfo)

public ModelServerInfo(ModelServerInfo other)
Parameter
Name Description
other ModelServerInfo

Properties

Model

public string Model { get; set; }

Required. The model. Open-source models follow the Huggingface Hub owner/model_name format. Use [GkeInferenceQuickstart.FetchModels][google.cloud.gkerecommender.v1.GkeInferenceQuickstart.FetchModels] to find available models.

Property Value
Type Description
string

ModelServer

public string ModelServer { get; set; }

Required. The model server. Open-source model servers use simplified, lowercase names (e.g., vllm). Use [GkeInferenceQuickstart.FetchModelServers][google.cloud.gkerecommender.v1.GkeInferenceQuickstart.FetchModelServers] to find available servers.

Property Value
Type Description
string

ModelServerVersion

public string ModelServerVersion { get; set; }

Optional. The model server version. Use [GkeInferenceQuickstart.FetchModelServerVersions][google.cloud.gkerecommender.v1.GkeInferenceQuickstart.FetchModelServerVersions] to find available versions. If not provided, the latest available version is used.

Property Value
Type Description
string