Class TokenCount (2.6.0)

2.6.0 (latest) 2.1.0 2.0.0 1.43.0 1.42.0 1.41.1 1.40.0 1.39.0 1.38.0 1.37.0 1.36.0 1.35.0 1.34.1 1.33.0 1.32.1 1.31.1 1.30.1 1.29.0 1.28.0 1.27.0 1.26.0 1.25.0 1.24.0 1.23.1 1.22.0 1.21.0 1.20.1 1.19.0 1.18.0 1.17.1 1.16.0 1.15.0 1.14.1 1.13.5 1.12.1 1.11.0 1.10.0 1.9.1 1.8.0 1.7.0 1.6.0 1.5.0 1.4.0 1.3.2 1.2.0 1.1.1 1.0.0 0.8.2 0.7.1 0.6.0 0.5.0 0.4.1 0.3.0 0.2.0 0.1.1

TokenCount(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Stores token counts of the LLM call.

Attributes
Name	Description
total_input_token_count	int The total number of tokens used for the input to the LLM call.
conversation_context_token_count	int The number of tokens used for the conversation history in the prompt.
example_token_count	int The number of tokens used for the retrieved examples in the prompt.
total_output_token_count	int The total number of tokens used for the output of the LLM call.