Vertex AI Search release notes

This page documents production updates to Vertex AI Search. Check this page for announcements about new or updated features, bug fixes, known issues, and deprecated functionality.

You can see the latest product updates for all of Google Cloud on the Google Cloud page, browse and filter all release notes in the Google Cloud console, or programmatically access release notes in BigQuery.

To get the latest product updates delivered to you, add the URL of this page to your feed reader, or add the feed URL directly.

June 06, 2025

Feature

Vertex AI Search: Skip layout parsing for types of HTML content (GA)

The layout parser can skip parsing specific types of HTML content. By excluding less relevant content such as boilerplate, you can improve data quality. The layout parser can exclude based on HTML tags and IDs and on CSS classes.

This feature is Generally Available (GA) and accessible only through the API. For more information, see Exclude HTML content.

April 07, 2025

Change

Vertex AI Search: Grounded generation with the generateGroundedContent API

The generateGroundedContent API to that grounds your answers with your inline text, Vertex AI Search data store, and Google Search is no longer available.

Instead, to generate grounded answers, Google recommends that you use the Generally Available groundContent API. You can either ground your answers with Google Search or with your own data. For more information, see Overview.

April 02, 2025

Change

AI Applications: Renamed from Vertex AI Agent Builder

The Vertex AI Agent Builder product has been renamed AI Applications. You'll see this new name in the product console, the documentation set, and the marketing collateral. The product functionality and endpoints remain the same.

March 19, 2025

Feature

Vertex AI Search: Return corpus images in answers and with follow-ups (Public Preview)

The answer method can return images in answers, along with text.

If appropriate, one image from the data store can be returned with the answer. Citations can also include images from the data store.

This feature is restricted to queries made to unstructured data stores where the layout parser is in effect and is only available through the API. For more information, see Retrieve existing images from the data store.

February 13, 2025

Feature

Vertex AI Search: Stream answers (GA)

Vertex AI Search now supports answer streaming. This feature returns generated answers in sequential parts, reducing the perception of latency. As the end users read the first part of the answer, the subsequent parts of the answer are being generated.

This feature also includes many of the features of the original answer method.

This feature is Generally Available to all customers. For more information, see Stream answers.

January 24, 2025

Feature

Vertex AI Search: Identity mapping store (GA)

You can map your identity provider (IDP) to external identities from third-party applications that aren't managed by your identity provider. This information allows Google to enforce access control correctly by syncing users from your IDP and third-party applications. For more information, see the IdentityMappingStore resource in the API docs.

January 14, 2025

Feature

Vertex AI Search: gemini-1.5-flash-001/answer_gen/v2 for healthcare

The gemini-1.5-flash-001/answer_gen/v2 model is available for answer generation in healthcare search apps.

For more information, see Available models.

December 04, 2024

Feature

Vertex AI Search: Boost controls for media recommendations (Public Preview)

Boost controls are used to affect the order in which recommendations are listed. Boost controls use filters on string and boolean values in the schema data to determine what media content to boost or bury. The boost value (-1 to 1) determines whether the content should be placed lower (buried) or higher (boosted) in the list of recommendations returned.

Boost controls are attached to serving configs and applied to recommend method calls.

The boost feature is in Public Preview and is available through the API. For more information about the feature, see Boost and bury media recommendations.

Feature

Vertex AI Search: gemini-1.5-flash-002-high-fidelity model (Public Preview)

The gemini-1.5-flash-002-high-fidelity model is available for grounded answer generation with RAG. This model is based on the gemini-1.5-flash-002 model and has been further tuned to address context-based question and answering tasks. This model is suitable for specialized industries, such as financial services, healthcare, and insurance.

This model is available in Public Preview.

For more information, see High fidelity models.

October 25, 2024

Feature

Vertex AI Search: Return only well-grounded answers with summaries and follow-ups (GA)

With the answer method, you can choose to filter out poorly-grounded answers. There are two filter levels: choose to return only answers with high grounding scores (at the risk of losing some helpful answers) or choose a lower filter to get more answers.

This feature is Generally Available (GA). For more information, see Show only well-grounded answers.

October 01, 2024

Feature

Vertex AI Agent Builder: Dynamic retrieval for grounded results (GA with allowlist)

Dynamic retrieval lets you choose when to turn off grounding with Google Search. This is useful when a prompt doesn't require an answer grounded in Google Search and the supported models can provide an answer based on their own knowledge without grounding. Dynamic retrieval helps you manage latency, quality, and cost more effectively.

This feature is available to select Google Cloud customers (GA with allowlist). For more information, see Dynamic retrieval.

September 25, 2024

Change

Vertex AI Search: Update to the preview model

The preview model for answer generation has been updated to gemini-1.5-pro-002 from gemini-1.5-pro-001.

For more information, see Answer generation model versions and lifecycle.

August 28, 2024

Feature

Vertex AI Search: Datetime and geolocation detection for structured data

By default, when structured data is imported, fields that are detected in datetime and geolocation format are assigned those types in the schema.

However, you can turn off datetime and geolocation detection so that in the schema the datetime fields are set to type string and the geolocation fields are set to type object.

For more information, see About providing your own schema as a JSON object.

July 19, 2024

Feature

Vertex AI Search: Multi-step retrieval for answer (GA)

For the answer method, multi-step retrieval using multi-step (ReAct) reasoning is Generally Available (GA).

For information about this feature, see Query rephrasing and Search and answer (specify maximum steps).

July 10, 2024

Feature

Vertex AI Search: Edit the schema for structured data on import (Public Preview)

When you create a data store by importing structured data from BigQuery or Cloud Storage, you can review and edit the schema before you import the data. This saves time over the alternative method of importing the data first and subsequently editing the schema.

This feature is available in Public Preview and applies to generic and media data stores. To try this feature for healthcare data stores, contact your Google account team and ask for access to the Private Preview.

Feature

Vertex AI Search: Bring your own schema for media data stores (Public Preview)

Previously, all media data stores had to follow a JSON schema for media predefined by Google. However, now you can use your own JSON schema for media data, provided that you map fields in your schema to the key properties: category, media_available_time, media_duration, title, and uri.

This feature is in Public Preview.

Feature

Vertex AI Search: Media app creation (Public Preview)

Media data stores can be created directly from the Data Stores page.

This is an alternative to the method where you create a media data store as part of the app creation workflow.

This feature is available in Public Preview.

July 03, 2024

Breaking

Vertex AI Search: On July 6, text-bison@001/answer_gen/v1 is discontinued

As of July 6, 2024, model version text-bison@001/answer_gen/v1 is discontinued.

If you specify text-bison@001/answer_gen/v1 by name in your search requests, replace text-bison@001/answer_gen/v1 with a newer model or with stable.

For more information, see Answer generation model versions and lifecycle.

Issue

Vertex AI Search: You can't use the Folder option to upload structured data from Cloud Storage

When creating a data store for structured or media data, you must use the File option when importing from a Cloud Storage bucket. Choosing the Folder option results in an error, "Schema preview failed. Requested entity was not found."

To work around this issue, use the File option and upload one file from the folder. After you've created the data store, import the folder contents from the Documents tab of the data store.

June 27, 2024

Feature

Vertex AI Search: Connect BigQuery datasets to Vertex AI Search (Public Preview)

You can create Vertex AI Search data stores that periodically sync with data in BigQuery datasets. You can choose how often you want to update your data stores: every day, every 3 days, or every 5 days.

Synchronizing BigQuery data to Vertex AI Search is available in Public Preview.

For more information, see Import from BigQuery.

June 24, 2024

Feature

Vertex AI Search: Check ingested data quality for media recommendations (Public Preview)

You can check the quality of your ingested data for media recommendations.

By running the Public Preview requirements:checkRequirement method, you find out if your data store meets the minimum quality requirements for your recommendations app. If your data doesn't meet the minimum threshold for the key metrics for your model and objective, you receive a warning about the issues. Address the issues and rerun the check.

For more information, see Check data quality for media recommendations.

June 21, 2024

Feature

Vertex AI Search: Answers with summaries and follow-ups (GA)

The answer API improves on the search with summary and search with follow-ups features. For example, it better handles complex queries and provides customization of answer styles.

The answer API is Generally Available (GA). However, the multi-step retrieval functionality remains in Public Preview.

For more information, see Get answers and follow-ups.

Feature

Vertex AI Search: The answer method can skip irrelevant answers

The answer method can be set to generate an answer only if at least one of the results is deemed relevant.

If you choose to ignore low relevant content and if all the results are deemed irrelevant or almost irrelevant, then the answer method doesn't generate an answer. Instead, a fallback message replaces the answer.

For more information, see Show only relevant answers.

Feature

Vertex AI Search: Add structured data for advanced website indexing (Public Preview)

If advanced website indexing is enabled in your data store, you can use structured data, such as schema.org data, to enrich your indexing.

For more information, see Use structured data for advanced site indexing.

Change

Vertex AI Search: The generated answer message doesn't contain the name field for synchronous and sessionless queries

The name field is only included in the answer response for session queries and for asynchronous queries. These are stateful and context-aware queries.

If a query is a synchronous and stateless query, the name field is no longer included in the generated answer message.

For more information about the answer method, see Get answers and follow-ups.

Feature

Vertex AI Search: Choose when to enable autocomplete

You can choose to enable autocomplete as soon as possible instead of waiting a couple of days for sufficiently good autocomplete data. If you choose to make autocomplete available sooner, at first, you won't get suggestions for all queries and some suggestions might be of poor quality.

For more information, see Enable autocomplete in Update autocomplete settings.

June 14, 2024

Feature

Vertex AI Search: Specify a language code in search request (Public Preview)

Setting a language code in a search query can improve the quality of the search results. Language codes in search queries are supported in Public Preview.

For information about the language code field in search, see the servingConfigs.search method.

May 31, 2024

Feature

Vertex AI Search: Document ranking API (GA)

The ranking API takes a list of documents and reranks those documents based on how relevant the documents are to a query. This is a stateless API that does not require you to index documents in advance.

The ranking API is Generally Available (GA).

For more information, see Rank and rerank documents.

May 14, 2024

Feature

Vertex AI Search: Check grounding (GA)

The check grounding API is Generally Available (GA).

The check grounding API determines how grounded a piece of text is in a given set of facts. The API returns support scores and citations.

Filler and introductory statements can be deemed as not requiring attribution. No scores or citations are provided for those statements.

Additionally, as an experimental feature, the API also generates contradicting citations that show which facts contradict the text and how strongly.

For more information, see Check grounding and the check API.

April 29, 2024

Feature

Vertex AI Search: Order healthcare search results (Public Preview)

When you search over FHIR resource types that contain unstructured text, you can order your search results according to their relevance to your query. For more information, see Order healthcare search results.

Feature

Vertex AI Search: Add structured data for advanced website indexing (Public Preview)

If advanced website indexing is enabled in your data store, you can use structured data, such as Google-inferred page dates, meta tags, and PageMap content, to enrich your indexing.

For more information, see Use structured data for advanced site indexing and Example use case using a Google-inferred page date.

Feature

Vertex AI Search: gemini-1.0-pro-002/answer_gen/v1 for answer generation

Model version gemini-1.0-pro-002/answer_gen/v1 is available for generating answers in Vertex AI Search. For more information, see Answer generation model versions and lifecycle.

April 09, 2024

Feature

Vertex AI Search: Document chunking support for more search types (Public Preview)

When document chunking is turned on for an unstructured data store, search summaries and search with follow-ups are supported in Public Preview.

For information, see Chunk documents for RAG.

Feature

Vertex AI Search: Check grounding (Public Preview)

The check grounding API is available as a Public Preview feature.

The check grounding API determines how grounded a piece of text is in a given set of facts. Perfect grounding requires that every statement in the text can be attributed to one or more of the given facts. The API returns support scores and citations.

Additionally, as an experimental feature, the API also generates contradicting citations that show which facts contradict the text and how strongly.

For more information, see Check grounding and the check API.

Feature

Vertex AI Search: Autocomplete support for healthcare search (Public Preview)

Autocomplete is available as a Public Preview feature for healthcare data search. The autocomplete configuration uses a canonical medical data source to generate autocomplete suggestions for healthcare data stores.

For more information, see Configure autocomplete.

Feature

Vertex AI Search: Connect Google Drive to Vertex AI Search (GA)

Syncing Google Drive data to Vertex AI Search is available in GA. For more information about creating a Google Drive data store, see Sync from Google Drive.

Feature

Vertex AI Search: Connect multiple search apps to the same data store (GA)

Connecting more than one generic search app to a single data store is supported in GA. With this capability, you can create multiple apps that search across the same data without having to ingest that data multiple times.

Feature

Vertex AI Search: Additional languages supported for media search

Vertex AI Search for media is supported in nine languages: Arabic, English, French, German, Hindi, Korean, Japanese, Portuguese, and Spanish.

For more information, see Languages.

Feature

Vertex AI Search: Search-as-you-type for media apps

Search results are returned after each character instead of after the full query is entered. Search-as-you-type is ideal for search apps with awkward input devices such as television remotes. You can enable search-as-you-type through the widget UI as well as through the API.

For more information, see Get search-as-you-type results for a media app.

March 28, 2024

Feature

Vertex AI Search: Autocomplete updates

Autocomplete is Generally Available (GA) for the US and EU multi-regions as well for the global region.

Autocomplete supports access transparency. This means that, when access transparency is enabled, if Google personal access your autocomplete data, this is recorded in the Access Transparency logs.

For information about autocomplete, see Configure autocomplete, and for information about Access Transparency, see Enable Access Transparency in Vertex AI Search.

Feature

Vertex AI Search: Structured data stores (GA)

Use of data stores containing structured data is Generally Available (GA). Additionally, two new field value types are allowed for structured data stores: geolocation and datetime.

For information about structured data stores, see Structured data in Prepare for ingesting and Schemas: auto-dectection versus providing you own.

Feature

Vertex AI Search: Boost search results (Public Preview)

Boosting search results using custom numerical attributes and according to freshness is available in Public Preview.

For more information, see Boost search results.

Feature

Vertex AI Search: Media recommendations analytics (GA)

Analytics for media recommendations are GA. You can view analytics for your media recommendations apps in the Google Cloud console.

For more information, see View analytics.

March 12, 2024

Announcement

Vertex AI Search: Vertex AI Search for healthcare (GA)

Vertex AI Search for healthcare is Generally Available (GA). Healthcare search lets you query healthcare records stored in FHIR data stores. For more information, see Vertex AI Search. With healthcare search, you can:

Feature

Vertex AI Search: Connect ServiceNow as a data source (Private Preview)

You can connect ServiceNow as a third-party data source for Vertex AI Search. For more information, see Connect a third-party data source.

Feature

Vertex AI Search: Specify a parser for unstructured content (Public Preview)

You can control how documents are parsed when they are uploaded to Vertex AI Search. Parser specification is available in Public Preview.

Vertex AI Search provides a digital parser (GA), an OCR parser for PDFs (Public Preview), and a layout parser (Public Preview). During data store creation for generic search apps with unstructured data, you can set a default parser for the data store and an override parser for specific file types.

For more information, see Parse documents.

Feature

Vertex AI Search: Turn on document chunking (Public Preview)

To use Vertex AI Search for retrieval-augmented generation (RAG) for LLMs, you can turn on document chunking when creating a data store. Document chunking is available in Public Preview.

When document chunking is turned on, your documents are split into chunks when you ingest documents into your data store, and your search app can return chunks of data in search results instead of full documents. Using chunked data for RAG increases relevance for LLM answers and reduces computational load for LLMs. Document chunking is in Public Preview. For more information, see Chunk documents for RAG.

March 05, 2024

Feature

Vertex AI Search: Watch time duration objective for media recommendations apps

When you create a media recommendations app, you can select watch duration per session as a business objective. Optimizing for watch duration per session maximizes the duration of media consumption.

For more information, see Watch duration per session.

February 28, 2024

Feature

Vertex AI Search: Add metadata to your web index (Public Preview)

If advanced website indexing is enabled in your data store, you can add metadata to the data store schema to enrich your indexing.

For more information, see Add metadata for advanced site indexing.

Feature

Vertex AI Search: Apply tuned search to some queries (Public Preview)

You can specify whether you want a query to use the tuned search model or the non-tuned search model. This is particularly helpful for testing the difference between the two versions of the model.

Previously, the tuned search model was enabled (or disabled) for all queries against the data store.

For more information, see Test tuned search and use it for individual search queries.

Feature

Vertex AI Search: Access controlled data sources (Public Preview)

Access control for BigQuery, Cloud Storage, and Confluence data is available in Public Preview. This feature allows you to limit the data that users can view in your search app's results. Google uses your identity provider to identify the end user performing a search and determine if they have access to the documents that are returned as results. Google Identity and third-party identity provider federation are supported.

For more information, see Use data source access control.

Feature

Vertex AI Search: Blended search (Public Preview)

Blended search, where multiple data stores can be connected to a single generic search app, is available in Public Preview. This feature allows you to use one generic search app to search across multiple sources and types of data.

For more information, see About connecting multiple data stores.

Feature

Vertex AI Search: Search analytics (GA)

Search analytics are GA for global data stores. For data stores in US and EU multi-regions, viewing analytics is in Public Preview.

For more information, see View analytics.

February 15, 2024

Feature

Vertex AI Search: Stable Gemini Pro answer generation model

gemini-pro@001/answer_gen/v1 is available as a stable, Generally Available model for answer generation. For information about all available models for answer generation, see Specify the summarization model.

January 31, 2024

Feature

Vertex AI Search and Conversation: Use Terraform to create data stores

You can use Terraform to create data stores for your Vertex AI Search and Conversation apps. The data stores are created empty; you then ingest the data through the console or an API call.

For information, see, for example, Create a search data store.

Feature

Vertex AI Search: Updates to autocomplete

  • Autocomplete is available for your search apps in the US and EU multi-regions as Public Preview.

    See Configure autocomplete.

  • Autocomplete removes unsafe and offensive terms in eight languages in addition to English (en).

    For more information, see Autocomplete features.

December 21, 2023

Feature

Vertex AI Search: Access controlled data sources in Preview with allowlist

Access control for BigQuery, Cloud Storage, and Confluence data is available in Preview with allowlist. This feature allows you to limit the data that users can view in your search app's results. Google uses your identity provider to identify the end user performing a search and determine if they have access to the documents that are returned as results. Google Identity and third-party identity provider federation are supported.

See Use data source access control.

Feature

Vertex AI Search: Bring your own parsed documents in Preview with allowlist

Importing pre-parsed unstructured documents into Vertex AI Search data stores is available in Preview with allowlist. For example, instead of importing a raw PDF document, you can parse the PDF yourself and import the parsing result instead. This lets you to import your documents in a structured way, ensuring that search and answer generation have full information about the document's layout and elements.

See Bring your own parsed document. For more information, contact your Google account team.

Change

Vertex AI Search: User events joined with documents asynchronously for generic apps

For generic search and recommendation apps, user events are joined with their associated documents asynchronously. For media apps, user events continue to be joined synchronously.

For more about user event import, see Import historical user events.

December 13, 2023

Feature

Vertex AI Search: Media search (Preview with allowlist)

You can create media search apps on media data stores. You can connect the media search app to an existing media data store or create a new one. You can also use document metadata to filter search queries of your media content.

Media search is available as a Preview with allowlist capability. To use this capability, contact your Google account team.

See About media documents and data stores and Filter media search.

Feature

Vertex AI Search: Filter search with follow-ups

You can filter your queries for search with follow-ups, both for website data and for structured data with metada.

See Filter search with follow-ups.

Feature

Vertex AI Search: Search tuning (Public Preview)

Search tuning is available as a Public Preview feature. You can upload additional training data to tune the model for your search app.

For information, see Improve search results with search tuning.

Feature

Vertex AI Search: Use multiple serving configs for media recommendations apps

For media recommendations apps, you can create, edit, and delete serving configs. Serving configs contain recommendation demotion and diversity configurations that are used when generating results. When you make recommendations calls to a media app, you can specify different serving configs to get different levels of demotion and diversity in recommendations from the same app.

For more information, see Create and manage serving configs.

Feature

Vertex AI Search: Citations with metadata for summaries (Public Preview)

When citations are turned on for summaries, the response includes citation metadata. This includes metadata about the sources that are being referenced and information about which sources apply to specific sentences in the summary.

See Get citations.

Feature

Vertex AI Search: OCR processing (Public Preview)

OCR processing is available in Public Preview. If you have non-searchable PDFs (scanned PDFs or PDFs with text inside images), you can turn on optical character recognition (OCR) processing during data store creation. This allows Vertex AI Search to extract elements such as text blocks and tables. If you instead have searchable PDFs that contain many tables, you might also consider turning on OCR processing with useNativeText set to true and enhancedDocumentElements set to table.

See OCR processing for PDFs.

Feature

Vertex AI Search: Blended search (Preview with allowlist)

Blended search, where multiple data stores can be connected to a single generic search app, is available in Preview with allowlist. This feature allows you to use one generic search app to search across multiple sources and types of data.

See About connecting multiple data stores.

Feature

Vertex AI Search: Company name field for search apps

When you create a search app, you supply the name of your company or organization. This can improve the quality of the responses for summarization and search with follow-ups.

See Create a search app.

Feature

Vertex AI Search: Upgrade to advanced website indexing

You can update an existing data store to advanced website indexing.

See Turn on advanced website indexing.

Feature

Vertex AI Search: Support for Access Transparency is GA

Access Transparency supports Vertex AI Search in GA.

See Enable Access Transparency in Vertex AI Search.

Feature

Vertex AI Search: Additional languages supported

The search, snippets, and extractive answers features are supported in 25 languages.

Summarization is supported in most languages.

See Languages.

Feature

Vertex AI Search: Estimate the size of your web data

You can call an API to get an estimate of the size of your web data prior to importing it into a data store. With this information, you can estimate your monthly storage costs using the Vertex AI Search and Conversation pricing page or the Google Cloud Pricing Calculator.

See Estimate the size of your web data.

Feature

Vertex AI Search: Customized Summaries is GA

Customized summaries are available in GA. For search with answers and search with follow-ups, you can provide free-form natural-language instructions to customize the summaries that are returned with your results. Customize summaries through the console for search widget results and through the API for other search requests.

For more information, see Get customizable summaries.

November 15, 2023

Feature

Vertex AI Search: Autocomplete denylist (Preview with allowlist)

Importing an autocomplete denylist is available as a preview with allowlist feature. To use this feature, contact your Google account team.

For information about autocomplete denylists, see Use an autocomplete denylist.

November 14, 2023

Feature

Vertex AI Search: Additional languages supported

Extractive answers are now supported in the following languages:

  • Arabic
  • Chinese (Simplified)
  • Japanese

See Languages.

November 09, 2023

Change

Vertex AI Search: New model for search summarization

A better model for generating search summaries has been launched. This underlying model improves the quality of search summaries and their grounding in the provided document corpus. You might see some differences in summary output after this update.

For more information about search summaries, see Get search summaries.

Change

Vertex AI Search: Confidence scores are changed to relevance scores (Preview with allowlist)

Confidence scores are renamed to relevance scores. Scores are returned in the relevanceScore field. Previously, they were returned in the confidenceScore field.

This feature is in preview with allowlist. For more information about relevance scores, see Get snippets and extracted content.

November 06, 2023

Feature

Vertex AI Search: Multi-region support for US and EU locations is GA

The US multi-region and the EU multi-region APIs are Generally Available (GA).

For more information about multi-regions including limitations, see Vertex AI Search locations.

October 27, 2023

Feature

Vertex AI Search: Create media recommendations in Vertex AI Search

You can now create apps for media recommendations in Vertex AI Search. Media recommendations include content such as videos, news, and music. For more information, see Vertex AI Search.

Important: If you are using Discovery for Media for media recommendations, you need to switch to the media recommendations capability of Vertex AI Search. All of the existing data and models that you created with Discovery for Media will automatically appear in the Vertex AI Search and Conversation console, with the models appearing as apps. For more information, see Migrate from Discovery for Media to media recommendations.

October 13, 2023

Feature

Vertex AI Search: Customer-managed encryption key integration for the EU

Customer-managed encryption keys (CMEK) is available in the EU as an allowlisted preview feature.

If you store your data in an EU multi-region data store, you can provide your own encryption key to protect your data at rest.

For information, see Customer-managed encryption keys.

October 09, 2023

Change

Vertex AI Search and Conversation: Renamed in the console and documentation

The Google Cloud console and the documentation at cloud.google.com have been updated to show the current product name for Vertex AI Search and Conversation. On the console, look for "Search and Conversation".

You might see the old name (Generative AI App Builder) in some places—for example, in the API reference.

September 29, 2023

Feature

Vertex AI Search (Enterprise Search): Customer-managed encryption key integration

Customer-managed encryption keys (CMEK) is available as an allowlisted preview feature.

If you store your data in a US multi-region data store, you can provide your own encryption key to protect your data at rest.

For information, see Customer-managed encryption keys.

Feature

Vertex AI Search (Enterprise Search): Search tuning

Search tuning is available as an allowlisted preview feature. You provide additional training data in the form of query and segment pairs. We use this data to tune the model for your app.

For information, see Improve search results with search tuning.

Announcement

Vertex AI Search (Enterprise Search): VPC Service Controls are GA

Virtual Private Cloud Service Controls support for Enterprise Search is Generally Available (GA).

For more information, see Supported products and limitations in the VPC Service Controls documentation. For general information about VPC Service Controls, see Overview of VPC Service Controls.

Feature

Vertex AI Search (Enterprise Search): Data location

Vertex AI Search may be configured for data location pursuant to the "Data Location" section of the Service Specific Terms.

For information about data residency in Vertex AI Search, see Enterprise Search locations.

Feature

Vertex AI Search (Enterprise Search): Support for Access Transparency

Access Transparency supports Vertex AI Search in preview.

For more information, see Enable Access Transparency in Enterprise Search.

Feature

Vertex AI Search (Enterprise Search): Citations for search with follow-ups

Citations indicate from which search results specific sentences in the summary are taken.

For more information, see Configure the summary.

Feature

Vertex AI Search (Enterprise Search): Ignore adversarial queries and non-summary seeking queries for search with follow-ups

Ignore adversarial queries can stop generation of summaries that are unsafe or violate policy.

Non-summary seeking queries stop generation of summaries that aren't helpful for some queries.

For more information, see Configure the summary.

Feature

Vertex AI Search (Enterprise Search): Additional languages supported

Search, snippets, and other features are now supported in the following languages:

  • Arabic
  • Chinese (Simplified)
  • Greek
  • Hebrew
  • Japanese
  • Korean
  • Polish
  • Russian

See Languages.

September 22, 2023

Feature

Vertex AI Search (Enterprise Search): Third-party data connectors

You can set up your Vertex AI Search data stores to sync with data from Jira, Confluence, or Salesforce.

This feature is in private preview. To try this feature, contact your Google account team to find out if you qualify.

For more about setting up a connection to third-party data, see Create an Enterprise Search data store.

September 20, 2023

Feature

Manually refresh your web pages

Call the recrawlUris method to manually refresh specific web pages in a data store with Advanced website indexing turned on. You can check the status of the recrawl operation by polling the operations.get method.

See Manually refresh your web pages.

September 19, 2023

Change

Vertex AI Search (Enterprise Search): Turn Enterprise edition on or off

You can turn Enterprise edition features on or off for existing apps.

For more about Enterprise edition, see About advanced features.

September 15, 2023

Feature

Vertex AI Search (Enterprise Search): Languages for summarization

Summarization is supported in the following languages in addition to English:

  • German (de-DE)
  • Spanish (es-ES)
  • Italian (it-IT)
  • French (fr-FR)
  • Dutch (nl-NL)
  • Portuguese (pt-BR)
  • Swedish (sv-SE)

See Languages.

Feature

Vertex AI Search (Enterprise Search): Adjacent segments for preview with allowlist

When getting extractive segments, you can also get up to 3 segments from immediately before and after the relevant segment. Adjacent segments can add context and accuracy to the relevant segment. Turning on adjacent segments can increase latency.

Adjacent segments is in preview with allowlist. Contact your Google account team to try out adjacent segments.

See Extractive segments.

Feature

Vertex AI Search (Enterprise Search): Customizable summaries for preview with allowlist

When you request summaries, you can customize them by providing natural-language instructions. You can request customizations such as such as the length and level of detail, style of output (such as "simple"), language of output, focus of answer, and format (such as tables, bullets, and XML).

Customizable summaries are in preview with allowlist. Contact your Google account team if you're interested in trying this feature.

See Get customizable summaries.

Announcement

Vertex AI Search (Enterprise Search): ISO compliance

Vertex AI Search meets ISO 27001, ISO 27017, ISO 27018, and ISO 27701 compliance standards.

See Compliance and security controls.

September 08, 2023

Announcement

Vertex AI Search (Enterprise Search): Image search is GA

Image search is now Generally Available (GA).

See Search for images using a website search engine.

Feature

Vertex AI Search (Enterprise Search): Page numbers for extractive segments

Page numbers can be returned with extractive segments. Page numbers indicate where an answer was extracted from in a document.

For more about extractive segments, see Get snippets and extracted content.

August 29, 2023

Announcement

Vertex AI Search and Conversation is the new product name for Generative AI App Builder.

Announcement

Generative AI App Builder: GA

Gen AI App Builder is publicly and Generally Available (GA).

Change

Separation of data stores and apps

Data stores and apps are separate entities. In the console, you can see your apps on the Apps page and your data stores on the Data Stores page. You can create a data store and attach it to an app during app creation, or create a new data store during app creation.

Apps and data stores have a one-to-one relationship. Each app is associated with one data store; they can't be disconnected after you attach them. This change does not affect the functionality of your existing apps.

Feature

Enterprise Search: Search with follow-ups is GA

Previously, the search with follow-ups feature was called multi-turn search.

Search with follow-ups is now Generally Available (GA).

Search with follow-ups can be applied to websites if advanced website indexing is enabled and to unstructured data.

In addition, to improve consistency between search with an answer and search with follow-ups, the response from the conversations.converse method v1 provides the summary object and no longer provides the reply and references objects. The response from the v1beta version of the method remains unchanged.

SafeSearch is available with the search with follow-ups feature.

For general information about search with follow-ups, see Search with follow-ups.

Feature

Enterprise Search: Improvements to snippets, extractive answers, and extractive segments

  • Snippet status is now returned along with the snippet.

  • Extractive answers include the document page number where the answer was found.

  • Up to 10 extractive segments can be returned for a search result.

See Get snippets and extracted content.

Feature

Enterprise Search: Multi-region support for US and EU locations

When you create a data store, you can specify global, the US multi-region, or the EU multi-region.

For more information including limitations associated with multi-region use, see Enterprise Search locations.

Feature

Enterprise Search: Languages

More features in more languages are supported for Enterprise Search.

See Languages.

Feature

Enterprise Search: Verify website domains

New requirement to verify your domain ownership for any websites in your data stores with advanced website indexing turned on.

See Verify website domains.

Feature

Enterprise Search: Confidence scores

Confidence scores for extractive segments are available in preview with allowlist. Scores are based on the similarity of the query to the extracted segment.

See Extractive segments.

Feature

Enterprise Search: Serving controls using the API are allowlisted GA

Boost, filter, synonym, and redirect serving controls affect search results returned through API method calls.

For more information, see Configure serving controls.

Feature

Enterprise Search: Related questions

Related questions are available as an allowlisted, preview feature for search with follow-ups.

For information, see Related questions.

August 18, 2023

Feature

Enterprise Search: Multi-turn, conversational search UI

Multi-turn, conversational search from within the Google Cloud console is available in preview.

For information, see Configure search results for unstructured data and Search with multi-turn.

Feature

Enterprise Search: Languages

Search results and snippets are supported in:

  • Danish (da-DK)
  • Dutch (nl-NL)
  • Hindi (hi-IN)
  • Portuguese (pt-BR)
  • Swedish (sv-SE)

Search results and snippets are also supported in English (en-US), French (fr-FR), Spanish (es-ES), German (de-DE), and Italian (it-IT).

For more information, see Languages.

August 09, 2023

Feature

Enterprise Search: Support for VPC Service Controls

VPC Service Controls supports Enterprise Search in preview.

For more information, see Supported products and limitations in the VPC Service Controls documentation. For general information about VPC Service Controls, see Overview of VPC Service Controls.

August 04, 2023

Change

Enterprise Search: Summaries are GA

Summaries for searches are now Generally Available (GA). These are a short summarization of the top one or more search results returned in a search response.

For more information, see Get search summaries.

Change

Enterprise Search: Citations are GA

Summary citations are now Generally Available (GA). Citations indicate from which search results specific sentences in the summary are taken.

For more information, see Get citations.

Change

Enterprise Search: Ignore adversarial and non-summary seeking queries are GA

The Ignore adversarial and non-summary seeking queries features are now Generally Available (GA).

For more information, see Ignore adversarial queries and Ignore non-summary seeking queries.

Feature

Enterprise Search: Languages

Search and snippets results are supported in French (fr-FR), in addition to English (en-US), Spanish (es-ES), German (de-DE), and Italian (it-IT).

For more information, see Languages.

August 02, 2023

Feature

Enterprise Search: Use custom embeddings

Bringing your own custom vector embeddings to Enterprise Search is supported in preview. If you've created your own embeddings on your data, you can upload them to Enterprise Search and use them when querying.

For more information, see Use custom embeddings.

July 20, 2023

Feature

Enterprise Search: Citations

Summary citations are now available in preview. Citations indicate from which search results specific sentences in the summary are taken.

For more information, see Get citations.

Feature

Enterprise Search: Ignore adverserial and non-summary seeking queries

You can now configure search requests so that adversarial queries and non-summary seeking queries do not include a summary in the response. This feature is in preview.

For more information, see Ignore adversarial queries and Ignore non-summary seeking queries.

Change

Enterprise Search: Personalize

We have renamed the "Personalize" feature of Generative AI App Builder to "Recommendations". This is a naming change only. There is no change to product functionality.

July 10, 2023

Breaking

Enterprise Search: Snippets no longer provide page numbers

Snippets are returned as brief extracts of text of uniform length. They no longer provide page numbers. If you previously used snippets as inputs for large language models to generate responses and summaries, we recommend using extractive answers or extractive segments. If you need page numbers in your extracts, we recommend using extractive answers, which provide page numbers where available.

Feature

Enterprise Search: Snippets with hit highlighting

Snippets in search responses are available with hit highlighting for rendering in UIs.

For more information, see Use snippets and extracted content.

Feature

Enterprise Search: Languages

Search and snippets results are supported in English (en-US), Spanish (es-ES), German (de-DE), and Italian (it-IT).

For more information, see Languages.

June 30, 2023

Feature

Enterprise Search: Image search

Search for images on your website. Provide an image (Base64 encoded PNG, JPG, or BMP) as the query and use an API method to return similar images.

For more information, see Search for images using a website search engine.

Feature

Enterprise Search: Extractive answers

Extractive answers are available in preview. An extractive answer is verbatim text that is returned with each search result. This text is extracted directly from the search result document and is typically displayed near the top of web pages to provide an end user with a brief answer that is contextually relevant to their query.

For more information, see Use snippets and extracted content.

Feature

Enterprise Search: Extractive segments

Extractive segments are available in preview. An extractive segment is verbatim text that is returned with each search result and is usually more verbose than an extractive answer. Extractive segments can be displayed as an answer to a query and be used in post-processing tasks and as input for large language models to generate answers or new text.

For more information, see Use snippets and extracted content.

Feature

Enterprise Search: OCR processing

Optical character recognition (OCR) processing is available, improving parsing and segmentation of PDF files at data ingestion. This enables Gen App Builder to take into account structures such as paragraphs and tables when ingesting your documents, providing more accurate search results, snippets, and summarizations. To request this functionality, contact your Google Cloud account team.

For more information, see OCR processing.

June 05, 2023

Breaking

Enterprise Search: Specify domains for the widget

To use the widget externally, you must provide a list of domains where the widget appears.

If, in an earlier version, you created a widget with API key authentication, that widget might not be supported.

To ensure that the widget continues working, you must reconfigure it: Follow the instructions on Add the widget to a webpage to specify one or more domains for your widget and to generate a fresh snippet for the widget.

Change

Enterprise Search: No API keys

Generated API keys are no longer used by the widget. You can enable Public Access instead.

Feature

Enterprise Search: PPTX, DOCX, and TXT formats

Enterprise Search supports search over PPTX, DOCX, and TXT documents as well as HTML and PDF documents. Support for the PPTX, DOCX, and TXT formats is available in preview.

For general information about unstructured data, see Unstructured data.

Feature

Personalize

Like Enterprise Search and Infobot, Personalize is a component of Gen App Builder. With Personalize, you build a state-of-the-art recommendation engines based on your own data. The recommendation engine uses AI to suggest documents that are similar to the document that the user is currently viewing.

Personalize is available in preview.

For information, see Get started with Personalize.

Feature

Enterprise Search: Multi-turn search

Multi-turn search is available in allowlisted preview. Multi-turn search enables follow up questions in context. For information, see Search with multi-turn.

Feature

Enterprise Search: Schema editing

Schemas for structured data stores can be viewed and updated from within the Google Cloud console. Schema editing is available in preview.

For information about schema viewing and editing, see View the schema definition for structured data, Update a schema for structured data, and Schemas: auto-detecting versus providing your own.

Feature

Enterprise Search: Purge data

The addition of the Purge Data button on the Documents page makes it easier to delete data from a data store. For information, see Delete data from a data store.

Feature

Enterprise Search: Collect feedback from users

You have the option to collect feedback (thumbs up or thumbs down) about the quality of the search results provided through the widget. Users who don't like the results can also select, from a list, the reason for their dislike. Feedback collection is available in preview.

For information about feedback collection, see Configure widget feedback.

Feature

Enterprise Search: Analytics

On the analytics dashboard, you can compare metrics for two time periods. The analytics dashboard is available in preview.

For information, see View analytics.

Feature

Enterprise Search: HIPAA compliance

Enterprise Search is ready to support HIPAA compliance.

Fixed

Enterprise Search: Re-import after changing the indexable setting on a field

It is no longer necessary to re-import data after changing an indexable field setting. See Configure search attributes.

April 28, 2023

Feature

Enterprise Search: Image search

Search for images on your website. Provide a text string as the query and use an API method to return images. For information, see Search for images using a website search engine.

Feature

Enterprise Search: Purge data

The addition of the documents.purge method makes it easier to delete data. For information, see Delete data from a datastore.

Feature

Enterprise Search: Advanced autocomplete

Experimental feature: The advanced autocomplete document data model uses Google's large language models to generate high-quality autocomplete suggestions. For information, see Experimental: Advanced autocomplete document data model.

April 14, 2023

Feature

Enterprise Search

Search engines for unstructured data can be created through the Google Cloud console. For information, see Console instructions: Create a search engine and ingest unstructured data.

March 29, 2023

Announcement

Generative AI App Builder is available for preview to those on the allowlist.