Manage your RAG knowledge base (corpus)

This page describes how you can manage your corpus for RAG tasks by performing corpus management and file management.

Corpus management

A corpus, also referred to as an index, is a collection of documents or source of information. The corpus can be queried to retrieve relevant contexts for response generation. When creating a corpus for the first time, the process might take an additional minute.

The following corpus operations are supported:

Operation Description Parameters Examples
Create a RAG corpus.

Create a RAG corpus to import or upload documents.

If you're using VPC-SC and it's the first time that you've called createRagCorpus and the call returns an error, then just wait a few minutes and retry.

Create parameters v1beta1

Create parameters v1

Update a RAG corpus. Update a previously-created RAG corpus to import or upload documents.

Update parameters v1beta1

Update parameters v1

List a RAG corpus. List all of the RAG corpora.

List parameters v1beta1

List parameters v1

Get a RAG corpus. Get the metadata describing the RAG corpus.

Get parameters v1beta1

Get parameters v1

Delete a RAG corpus. Delete the RAG corpus.

Delete parameters v1beta1

Delete parameters v1

Concurrent operations on corpora aren't supported. For more information, see the RAG API reference for v1beta1 or RAG API reference for v1.

File management

The following file operations are supported:

Operation Description Parameters Examples
Upload a RAG file. Upload a file from local storage with additional information that provides context to the LLM to generate more accurate responses.

Upload parameters v1beta1

Upload parameters v1

Import RAG files. Import a set of files from some other storage into a storage location.

Import parameters v1beta1

Import parameters v1

List RAG files. List all of the files in the RAG corpus.

List parameters v1beta1

List parameters v1

Get a RAG file. Get details about a RAG file for use by the LLM.

Get parameters v1beta1

Get parameters v1

Delete a RAG file. Delete a file from the RAG corpus.

Delete parameters v1beta1

Delete parameters v1

What's next