LatencyReport(mapping=None, *, ignore_unknown_fields=False, **kwargs)Latency report for the evaluation run.
Attributes |
|
|---|---|
| Name | Description |
tool_latencies |
MutableSequence[google.cloud.ces_v1beta.types.LatencyReport.ToolLatency]
Output only. Unordered list. Latency metrics for each tool. |
callback_latencies |
MutableSequence[google.cloud.ces_v1beta.types.LatencyReport.CallbackLatency]
Output only. Unordered list. Latency metrics for each callback. |
guardrail_latencies |
MutableSequence[google.cloud.ces_v1beta.types.LatencyReport.GuardrailLatency]
Output only. Unordered list. Latency metrics for each guardrail. |
llm_call_latencies |
MutableSequence[google.cloud.ces_v1beta.types.LatencyReport.LlmCallLatency]
Output only. Unordered list. Latency metrics for each LLM call. |
session_count |
int
Output only. The total number of sessions considered in the latency report. |
Classes
CallbackLatency
CallbackLatency(mapping=None, *, ignore_unknown_fields=False, **kwargs)Latency metrics for a single callback.
GuardrailLatency
GuardrailLatency(mapping=None, *, ignore_unknown_fields=False, **kwargs)Latency metrics for a single guardrail.
LatencyMetrics
LatencyMetrics(mapping=None, *, ignore_unknown_fields=False, **kwargs)Latency metrics for a component.
LlmCallLatency
LlmCallLatency(mapping=None, *, ignore_unknown_fields=False, **kwargs)Latency metrics for a single LLM call.
ToolLatency
ToolLatency(mapping=None, *, ignore_unknown_fields=False, **kwargs)Latency metrics for a single tool.
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields