Interface PerformanceRequirementsOrBuilder (0.1.0)

public interface PerformanceRequirementsOrBuilder extends MessageOrBuilder

Implements

MessageOrBuilder

Methods

getTargetCost()

public abstract Cost getTargetCost()

Optional. The target cost for running a profile's model server. If not provided, this requirement will not be enforced.

.google.cloud.gkerecommender.v1.Cost target_cost = 3 [(.google.api.field_behavior) = OPTIONAL];

Returns
Type Description
Cost

The targetCost.

getTargetCostOrBuilder()

public abstract CostOrBuilder getTargetCostOrBuilder()

Optional. The target cost for running a profile's model server. If not provided, this requirement will not be enforced.

.google.cloud.gkerecommender.v1.Cost target_cost = 3 [(.google.api.field_behavior) = OPTIONAL];

Returns
Type Description
CostOrBuilder

getTargetNtpotMilliseconds()

public abstract int getTargetNtpotMilliseconds()

Optional. The target Normalized Time Per Output Token (NTPOT) in milliseconds. NTPOT is calculated as request_latency / total_output_tokens. If not provided, this target will not be enforced.

optional int32 target_ntpot_milliseconds = 1 [(.google.api.field_behavior) = OPTIONAL];

Returns
Type Description
int

The targetNtpotMilliseconds.

getTargetTtftMilliseconds()

public abstract int getTargetTtftMilliseconds()

Optional. The target Time To First Token (TTFT) in milliseconds. TTFT is the time it takes to generate the first token for a request. If not provided, this target will not be enforced.

optional int32 target_ttft_milliseconds = 2 [(.google.api.field_behavior) = OPTIONAL];

Returns
Type Description
int

The targetTtftMilliseconds.

hasTargetCost()

public abstract boolean hasTargetCost()

Optional. The target cost for running a profile's model server. If not provided, this requirement will not be enforced.

.google.cloud.gkerecommender.v1.Cost target_cost = 3 [(.google.api.field_behavior) = OPTIONAL];

Returns
Type Description
boolean

Whether the targetCost field is set.

hasTargetNtpotMilliseconds()

public abstract boolean hasTargetNtpotMilliseconds()

Optional. The target Normalized Time Per Output Token (NTPOT) in milliseconds. NTPOT is calculated as request_latency / total_output_tokens. If not provided, this target will not be enforced.

optional int32 target_ntpot_milliseconds = 1 [(.google.api.field_behavior) = OPTIONAL];

Returns
Type Description
boolean

Whether the targetNtpotMilliseconds field is set.

hasTargetTtftMilliseconds()

public abstract boolean hasTargetTtftMilliseconds()

Optional. The target Time To First Token (TTFT) in milliseconds. TTFT is the time it takes to generate the first token for a request. If not provided, this target will not be enforced.

optional int32 target_ttft_milliseconds = 2 [(.google.api.field_behavior) = OPTIONAL];

Returns
Type Description
boolean

Whether the targetTtftMilliseconds field is set.