Vertex AI v1beta1 API - Class PredictionServiceSettings (1.0.0-beta61)

Version latest

• 1.0.0-beta61 (latest)
• 1.0.0-beta60

public sealed class PredictionServiceSettings : ServiceSettingsBase

Reference documentation and code samples for the Vertex AI v1beta1 API class PredictionServiceSettings.

Settings for PredictionServiceClient instances.

Inheritance

object > ServiceSettingsBase > PredictionServiceSettings

Inherited Members

ServiceSettingsBase.VersionHeaderBuilder

ServiceSettingsBase.CallSettings

ServiceSettingsBase.Clock

ServiceSettingsBase.Scheduler

ServiceSettingsBase.Interceptor

object.GetHashCode()

object.GetType()

object.ToString()

Namespace

Google.Cloud.AIPlatform.V1Beta1

Assembly

Google.Cloud.AIPlatform.V1Beta1.dll

Constructors

PredictionServiceSettings()

public PredictionServiceSettings()

Constructs a new PredictionServiceSettings object with default settings.

Properties

ChatCompletionsSettings

public CallSettings ChatCompletionsSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.ChatCompletions and PredictionServiceClient.ChatCompletionsAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

CountTokensSettings

public CallSettings CountTokensSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.CountTokens and PredictionServiceClient.CountTokensAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

DirectPredictSettings

public CallSettings DirectPredictSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.DirectPredict and PredictionServiceClient.DirectPredictAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

DirectRawPredictSettings

public CallSettings DirectRawPredictSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.DirectRawPredict and PredictionServiceClient.DirectRawPredictAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

EmbedContentSettings

public CallSettings EmbedContentSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.EmbedContent and PredictionServiceClient.EmbedContentAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

ExplainSettings

public CallSettings ExplainSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.Explain and PredictionServiceClient.ExplainAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• Timeout: 5 seconds.

GenerateContentSettings

public CallSettings GenerateContentSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.GenerateContent and PredictionServiceClient.GenerateContentAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

IAMPolicySettings

public IAMPolicySettings IAMPolicySettings { get; set; }

The settings to use for the IAMPolicyClient associated with the client.

Property Value
Type	Description
IAMPolicySettings

LocationsSettings

public LocationsSettings LocationsSettings { get; set; }

The settings to use for the LocationsClient associated with the client.

Property Value
Type	Description
LocationsSettings

PredictSettings

public CallSettings PredictSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.Predict and PredictionServiceClient.PredictAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• Timeout: 5 seconds.

RawPredictSettings

public CallSettings RawPredictSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.RawPredict and PredictionServiceClient.RawPredictAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

ServerStreamingPredictSettings

public CallSettings ServerStreamingPredictSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.ServerStreamingPredict and PredictionServiceClient.ServerStreamingPredictAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

StreamDirectPredictSettings

public CallSettings StreamDirectPredictSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.StreamDirectPredict and PredictionServiceClient.StreamDirectPredictAsync .

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

StreamDirectPredictStreamingSettings

public BidirectionalStreamingSettings StreamDirectPredictStreamingSettings { get; set; }

BidirectionalStreamingSettings for calls to PredictionServiceClient.StreamDirectPredict and PredictionServiceClient.StreamDirectPredictAsync .

Property Value
Type	Description
BidirectionalStreamingSettings

Remarks

The default local send queue size is 100.

StreamDirectRawPredictSettings

public CallSettings StreamDirectRawPredictSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.StreamDirectRawPredict and PredictionServiceClient.StreamDirectRawPredictAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

StreamDirectRawPredictStreamingSettings

public BidirectionalStreamingSettings StreamDirectRawPredictStreamingSettings { get; set; }

BidirectionalStreamingSettings for calls to PredictionServiceClient.StreamDirectRawPredict and PredictionServiceClient.StreamDirectRawPredictAsync.

Property Value
Type	Description
BidirectionalStreamingSettings

Remarks

The default local send queue size is 100.

StreamGenerateContentSettings

public CallSettings StreamGenerateContentSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.StreamGenerateContent and PredictionServiceClient.StreamGenerateContentAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

StreamRawPredictSettings

public CallSettings StreamRawPredictSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.StreamRawPredict and PredictionServiceClient.StreamRawPredictAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

StreamingPredictSettings

public CallSettings StreamingPredictSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.StreamingPredict and PredictionServiceClient.StreamingPredictAsync.

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

StreamingPredictStreamingSettings

public BidirectionalStreamingSettings StreamingPredictStreamingSettings { get; set; }

BidirectionalStreamingSettings for calls to PredictionServiceClient.StreamingPredict and PredictionServiceClient.StreamingPredictAsync.

Property Value
Type	Description
BidirectionalStreamingSettings

Remarks

The default local send queue size is 100.

StreamingRawPredictSettings

public CallSettings StreamingRawPredictSettings { get; set; }

CallSettings for synchronous and asynchronous calls to PredictionServiceClient.StreamingRawPredict and PredictionServiceClient.StreamingRawPredictAsync .

Property Value
Type	Description
CallSettings

Remarks

• This call will not be retried.
• No timeout is applied.

StreamingRawPredictStreamingSettings

public BidirectionalStreamingSettings StreamingRawPredictStreamingSettings { get; set; }

BidirectionalStreamingSettings for calls to PredictionServiceClient.StreamingRawPredict and PredictionServiceClient.StreamingRawPredictAsync .

Property Value
Type	Description
BidirectionalStreamingSettings

Remarks

The default local send queue size is 100.

Methods

Clone()

public PredictionServiceSettings Clone()

Creates a deep clone of this object, with all the same property values.

Returns
Type	Description
PredictionServiceSettings	A deep clone of this PredictionServiceSettings object.

GetDefault()

public static PredictionServiceSettings GetDefault()

Get a new instance of the default PredictionServiceSettings.

Returns
Type	Description
PredictionServiceSettings	A new instance of the default PredictionServiceSettings.