public interface PerformanceRangeOrBuilder extends MessageOrBuilderImplements
MessageOrBuilderMethods
getNtpotRange()
public abstract MillisecondRange getNtpotRange()Output only. The range of NTPOT (Normalized Time Per Output Token) in milliseconds. NTPOT is the request latency normalized by the number of output tokens, measured as request_latency / total_output_tokens.
.google.cloud.gkerecommender.v1.MillisecondRange ntpot_range = 3 [(.google.api.field_behavior) = OUTPUT_ONLY];
| Returns | |
|---|---|
| Type | Description |
MillisecondRange |
The ntpotRange. |
getNtpotRangeOrBuilder()
public abstract MillisecondRangeOrBuilder getNtpotRangeOrBuilder()Output only. The range of NTPOT (Normalized Time Per Output Token) in milliseconds. NTPOT is the request latency normalized by the number of output tokens, measured as request_latency / total_output_tokens.
.google.cloud.gkerecommender.v1.MillisecondRange ntpot_range = 3 [(.google.api.field_behavior) = OUTPUT_ONLY];
| Returns | |
|---|---|
| Type | Description |
MillisecondRangeOrBuilder |
|
getThroughputOutputRange()
public abstract TokensPerSecondRange getThroughputOutputRange()Output only. The range of throughput in output tokens per second. This is measured as total_output_tokens_generated_by_server / elapsed_time_in_seconds.
.google.cloud.gkerecommender.v1.TokensPerSecondRange throughput_output_range = 1 [(.google.api.field_behavior) = OUTPUT_ONLY];
| Returns | |
|---|---|
| Type | Description |
TokensPerSecondRange |
The throughputOutputRange. |
getThroughputOutputRangeOrBuilder()
public abstract TokensPerSecondRangeOrBuilder getThroughputOutputRangeOrBuilder()Output only. The range of throughput in output tokens per second. This is measured as total_output_tokens_generated_by_server / elapsed_time_in_seconds.
.google.cloud.gkerecommender.v1.TokensPerSecondRange throughput_output_range = 1 [(.google.api.field_behavior) = OUTPUT_ONLY];
| Returns | |
|---|---|
| Type | Description |
TokensPerSecondRangeOrBuilder |
|
getTtftRange()
public abstract MillisecondRange getTtftRange()Output only. The range of TTFT (Time To First Token) in milliseconds. TTFT is the time it takes to generate the first token for a request.
.google.cloud.gkerecommender.v1.MillisecondRange ttft_range = 2 [(.google.api.field_behavior) = OUTPUT_ONLY];
| Returns | |
|---|---|
| Type | Description |
MillisecondRange |
The ttftRange. |
getTtftRangeOrBuilder()
public abstract MillisecondRangeOrBuilder getTtftRangeOrBuilder()Output only. The range of TTFT (Time To First Token) in milliseconds. TTFT is the time it takes to generate the first token for a request.
.google.cloud.gkerecommender.v1.MillisecondRange ttft_range = 2 [(.google.api.field_behavior) = OUTPUT_ONLY];
| Returns | |
|---|---|
| Type | Description |
MillisecondRangeOrBuilder |
|
hasNtpotRange()
public abstract boolean hasNtpotRange()Output only. The range of NTPOT (Normalized Time Per Output Token) in milliseconds. NTPOT is the request latency normalized by the number of output tokens, measured as request_latency / total_output_tokens.
.google.cloud.gkerecommender.v1.MillisecondRange ntpot_range = 3 [(.google.api.field_behavior) = OUTPUT_ONLY];
| Returns | |
|---|---|
| Type | Description |
boolean |
Whether the ntpotRange field is set. |
hasThroughputOutputRange()
public abstract boolean hasThroughputOutputRange()Output only. The range of throughput in output tokens per second. This is measured as total_output_tokens_generated_by_server / elapsed_time_in_seconds.
.google.cloud.gkerecommender.v1.TokensPerSecondRange throughput_output_range = 1 [(.google.api.field_behavior) = OUTPUT_ONLY];
| Returns | |
|---|---|
| Type | Description |
boolean |
Whether the throughputOutputRange field is set. |
hasTtftRange()
public abstract boolean hasTtftRange()Output only. The range of TTFT (Time To First Token) in milliseconds. TTFT is the time it takes to generate the first token for a request.
.google.cloud.gkerecommender.v1.MillisecondRange ttft_range = 2 [(.google.api.field_behavior) = OUTPUT_ONLY];
| Returns | |
|---|---|
| Type | Description |
boolean |
Whether the ttftRange field is set. |