Resource: Extension
extensions are tools for large language models to access external data, run computations, etc.
namestring
Identifier. The resource name of the Extension.
displayNamestring
Required. The display name of the Extension. The name can be up to 128 characters long and can consist of any UTF-8 characters.
descriptionstring
Optional. The description of the Extension.
Output only. timestamp when this Extension was created.
Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: "2014-10-02T15:01:23Z", "2014-10-02T15:01:23.045123456Z" or "2014-10-02T15:01:23+05:30".
Output only. timestamp when this Extension was most recently updated.
Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: "2014-10-02T15:01:23Z", "2014-10-02T15:01:23.045123456Z" or "2014-10-02T15:01:23+05:30".
etagstring
Optional. Used to perform consistent read-modify-write updates. If not set, a blind "overwrite" update happens.
Required. Manifest of the Extension.
Output only. Supported operations.
Optional. Runtime config controlling the runtime behavior of this Extension.
Optional. Examples to illustrate the usage of the extension as a tool.
Optional. The PrivateServiceConnect config for the extension. If specified, the service endpoints associated with the Extension should be registered with private network access in the provided service Directory.
If the service contains more than one endpoint with a network, the service will arbitrarilty choose one of the endpoints to use for extension execution.
satisfiesPzsboolean
Output only. reserved for future use.
satisfiesPziboolean
Output only. reserved for future use.
| JSON representation |
|---|
{ "name": string, "displayName": string, "description": string, "createTime": string, "updateTime": string, "etag": string, "manifest": { object ( |
ExtensionManifest
Manifest spec of an Extension needed for runtime execution.
namestring
Required. Extension name shown to the LLM. The name can be up to 128 characters long.
descriptionstring
Required. The natural language description shown to the LLM. It should describe the usage of the extension, and is essential for the LLM to perform reasoning. e.g., if the extension is a data store, you can let the LLM know what data it contains.
Required. Immutable. The API specification shown to the LLM.
Required. Immutable. type of auth supported by this extension.
| JSON representation |
|---|
{ "name": string, "description": string, "apiSpec": { object ( |
ApiSpec
The API specification shown to the LLM.
api_specUnion type
api_spec can be only one of the following:openApiYamlstring
The API spec in Open API standard and YAML format.
openApiGcsUristring
Cloud Storage URI pointing to the OpenAPI spec.
| JSON representation |
|---|
{ // api_spec "openApiYaml": string, "openApiGcsUri": string // Union type } |
AuthConfig
Auth configuration to run the extension.
type of auth scheme.
auth_configUnion type
auth_config can be only one of the following:Config for API key auth.
Config for HTTP Basic auth.
Config for Google service Account auth.
Config for user oauth.
Config for user OIDC auth.
| JSON representation |
|---|
{ "authType": enum ( |
ApiKeyConfig
Config for authentication with API key.
namestring
Optional. The parameter name of the API key. E.g. If the API request is "https://example.com/act?apiKey=
apiKeySecretstring
Optional. The name of the SecretManager secret version resource storing the API key. Format: projects/{project}/secrets/{secrete}/versions/{version}
If both
apiKeySecretandapiKeyStringare specified, this field takes precedence overapiKeyString.If specified, the
secretmanager.versions.accesspermission should be granted to Vertex AI Extension service Agent (https://cloud.google.com/vertex-ai/docs/general/access-control#service-agents) on the specified resource.
Optional. The location of the API key.
| JSON representation |
|---|
{
"name": string,
"apiKeySecret": string,
"httpElementLocation": enum ( |
HttpElementLocation
Enum of location an HTTP element can be.
| Enums | |
|---|---|
HTTP_IN_UNSPECIFIED |
|
HTTP_IN_QUERY |
Element is in the HTTP request query. |
HTTP_IN_HEADER |
Element is in the HTTP request header. |
HTTP_IN_PATH |
Element is in the HTTP request path. |
HTTP_IN_BODY |
Element is in the HTTP request body. |
HTTP_IN_COOKIE |
Element is in the HTTP request cookie. |
HttpBasicAuthConfig
Config for HTTP Basic Authentication.
credentialSecretstring
Required. The name of the SecretManager secret version resource storing the base64 encoded credentials. Format: projects/{project}/secrets/{secrete}/versions/{version}
- If specified, the
secretmanager.versions.accesspermission should be granted to Vertex AI Extension service Agent (https://cloud.google.com/vertex-ai/docs/general/access-control#service-agents) on the specified resource.
| JSON representation |
|---|
{ "credentialSecret": string } |
GoogleServiceAccountConfig
Config for Google service Account Authentication.
serviceAccountstring
Optional. The service account that the extension execution service runs as.
If the service account is specified, the
iam.serviceAccounts.getAccessTokenpermission should be granted to Vertex AI Extension service Agent (https://cloud.google.com/vertex-ai/docs/general/access-control#service-agents) on the specified service account.If not specified, the Vertex AI Extension service Agent will be used to execute the Extension.
| JSON representation |
|---|
{ "serviceAccount": string } |
OauthConfig
Config for user oauth.
oauth_configUnion type
oauth_config can be only one of the following:accessTokenstring
Access token for extension endpoint. Only used to propagate token from [[ExecuteExtensionRequest.runtime_auth_config]] at request time.
serviceAccountstring
The service account used to generate access tokens for executing the Extension.
- If the service account is specified, the
iam.serviceAccounts.getAccessTokenpermission should be granted to Vertex AI Extension service Agent (https://cloud.google.com/vertex-ai/docs/general/access-control#service-agents) on the provided service account.
| JSON representation |
|---|
{ // oauth_config "accessToken": string, "serviceAccount": string // Union type } |
OidcConfig
Config for user OIDC auth.
oidc_configUnion type
oidc_config can be only one of the following:idTokenstring
OpenID Connect formatted id token for extension endpoint. Only used to propagate token from [[ExecuteExtensionRequest.runtime_auth_config]] at request time.
serviceAccountstring
The service account used to generate an OpenID Connect (OIDC)-compatible JWT token signed by the Google OIDC Provider (accounts.google.com) for extension endpoint (https://cloud.google.com/iam/docs/create-short-lived-credentials-direct#sa-credentials-oidc).
The audience for the token will be set to the URL in the server url defined in the OpenApi spec.
If the service account is provided, the service account should grant
iam.serviceAccounts.getOpenIdTokenpermission to Vertex AI Extension service Agent (https://cloud.google.com/vertex-ai/docs/general/access-control#service-agents).
| JSON representation |
|---|
{ // oidc_config "idToken": string, "serviceAccount": string // Union type } |
AuthType
type of Auth.
| Enums | |
|---|---|
AUTH_TYPE_UNSPECIFIED |
|
NO_AUTH |
No Auth. |
API_KEY_AUTH |
API Key Auth. |
HTTP_BASIC_AUTH |
HTTP Basic Auth. |
GOOGLE_SERVICE_ACCOUNT_AUTH |
Google service Account Auth. |
OAUTH |
OAuth auth. |
OIDC_AUTH |
OpenID Connect (OIDC) Auth. |
ExtensionOperation
Operation of an extension.
operationIdstring
Operation id that uniquely identifies the operations among the extension. See: "Operation Object" in https://swagger.io/specification/.
This field is parsed from the OpenAPI spec. For HTTP extensions, if it does not exist in the spec, we will generate one from the HTTP method and path.
Output only. Structured representation of a function declaration as defined by the OpenAPI Spec.
| JSON representation |
|---|
{
"operationId": string,
"functionDeclaration": {
object ( |
RuntimeConfig
Runtime configuration to run the extension.
Optional. Default parameters that will be set for all the execution of this extension. If specified, the parameter values can be overridden by values in [[ExecuteExtensionRequest.operation_params]] at request time.
The struct should be in a form of map with param name as the key and actual param value as the value. E.g. If this operation requires a param "name" to be set to "abc". you can set this to something like {"name": "abc"}.
GoogleFirstPartyExtensionConfigUnion type
GoogleFirstPartyExtensionConfig can be only one of the following:code execution runtime configurations for code interpreter extension.
Runtime configuration for Vertex AI Search extension.
| JSON representation |
|---|
{ "defaultParams": { object }, // GoogleFirstPartyExtensionConfig "codeInterpreterRuntimeConfig": { object ( |
CodeInterpreterRuntimeConfig
fileInputGcsBucketstring
Optional. The Cloud Storage bucket for file input of this Extension. If specified, support input from the Cloud Storage bucket. Vertex Extension Custom code service Agent should be granted file reader to this bucket. If not specified, the extension will only accept file contents from request body and reject Cloud Storage file inputs.
fileOutputGcsBucketstring
Optional. The Cloud Storage bucket for file output of this Extension. If specified, write all output files to the Cloud Storage bucket. Vertex Extension Custom code service Agent should be granted file writer to this bucket. If not specified, the file content will be output in response body.
| JSON representation |
|---|
{ "fileInputGcsBucket": string, "fileOutputGcsBucket": string } |
VertexAISearchRuntimeConfig
servingConfigNamestring
Optional. Vertex AI Search serving config name. Format: projects/{project}/locations/{location}/collections/{collection}/engines/{engine}/servingConfigs/{servingConfig}
engineIdstring
Optional. Vertex AI Search engine id. This is used to construct the search request. By setting this engineId, API will construct the serving config using the default value to call search API for the user. The engineId and servingConfigName cannot both be empty at the same time.
| JSON representation |
|---|
{ "servingConfigName": string, "engineId": string } |
ToolUseExample
A single example of the tool usage.
displayNamestring
Required. The display name for example.
querystring
Required. Query that should be routed to this tool.
Request parameters used for executing this tool.
Response parameters generated by this tool.
responseSummarystring
Summary of the tool response to the user query.
TargetUnion type
Target can be only one of the following:Extension operation to call.
functionNamestring
Function name to call.
| JSON representation |
|---|
{
"displayName": string,
"query": string,
"requestParams": {
object
},
"responseParams": {
object
},
"responseSummary": string,
// Target
"extensionOperation": {
object ( |
ExtensionOperation
Identifies one operation of the extension.
extensionstring
Resource name of the extension.
operationIdstring
Required. Operation id of the extension.
| JSON representation |
|---|
{ "extension": string, "operationId": string } |
ExtensionPrivateServiceConnectConfig
PrivateExtensionConfig configuration for the extension.
serviceDirectorystring
Required. The service Directory resource name in which the service endpoints associated to the extension are registered. Format: projects/{projectId}/locations/{locationId}/namespaces/{namespaceId}/services/{serviceId}
- The Vertex AI Extension service Agent (https://cloud.google.com/vertex-ai/docs/general/access-control#service-agents) should be granted
servicedirectory.viewerandservicedirectory.pscAuthorizedServiceroles on the resource.
| JSON representation |
|---|
{ "serviceDirectory": string } |
Methods |
|
|---|---|
|
Deletes an Extension. |
|
Executes the request against a given extension. |
|
Gets an Extension. |
|
Imports an Extension. |
|
Lists Extensions in a location. |
|
Updates an Extension. |
|
Queries an extension with a default controller. |