Resume an incomplete batch inference job

If a Generative AI on Vertex AI batch inference job fails, is canceled, or expires, you can resume it by creating a new batch job. The new job only processes the incomplete or failed requests from the previous job, merging the new results with those from the previously completed requests. For example, if the incomplete batch job was 90% complete, the new job processes the remaining 10% of the requests.

To resume a batch job, create a new batch job, supplying the Cloud Storage file or BigQuery table output as input to the new job.

Note: In rare cases where users modify the output file of the job before resuming, the system resumes from the modified output file. The system doesn't validate whether the output file has been modified.

What's next

• Learn more about Batch prediction from Cloud Storage.
• Learn more about Batch prediction for BigQuery.