ComputeTokensResponse

Response message for ComputeTokens RPC call.

Fields
tokensInfo[] object (TokensInfo)

Lists of tokens info from the input. A ComputeTokensRequest could have multiple instances with a prompt in each instance. We also need to return lists of tokens info for the request with multiple instances.

JSON representation 
{
  "tokensInfo": [
    {
      object (TokensInfo)
    }
  ]
}

TokensInfo

Tokens info with a list of tokens and the corresponding list of token ids.

Fields
tokens[] string (bytes format)

A list of tokens from the input.

A base64-encoded string.

tokenIds[] string (int64 format)

A list of token ids from the input.

role string

Optional. Optional fields for the role from the corresponding Content.

JSON representation 
{
  "tokens": [
    string
  ],
  "tokenIds": [
    string
  ],
  "role": string
}