Quotas and limits

Confidential VM is subject to the Compute Engine resource quotas because it is a type of Compute Engine VM.

What is a quota?

Google Cloud uses quotas to help ensure fairness and reduce spikes in resource use and availability. A quota restricts how much of a Google Cloud resource your Google Cloud project can use. Quotas apply to a range of resource types, including hardware, software, and network components. For example, quotas can restrict the number of API calls to a service, the number of load balancers used concurrently by your project, or the number of projects that you can create. Quotas protect the community of Google Cloud users by preventing the overloading of services. Quotas also help you to manage your own Google Cloud resources.

The Cloud Quotas system does the following:

• Monitors your consumption of Google Cloud products and services
• Restricts your consumption of those resources
• Provides a way to request changes to the quota value and automate quota adjustments

In most cases, when you attempt to consume more of a resource than its quota allows, the system blocks access to the resource, and the task that you're trying to perform fails.

Quotas generally apply at the Google Cloud project level. Your use of a resource in one project doesn't affect your available quota in another project. Within a Google Cloud project, quotas are shared across all applications and IP addresses.

For more information, see the Cloud Quotas overview.

View quota values

Not all projects have the same quota values. As you use Google Cloud, your quotas may increase accordingly. Learn how to view your quota values.

Increase your quota

To adjust most quotas, use the Google Cloud console. For more information, see Request a quota adjustment.

For NVIDIA RTX PRO 6000 quota requests, see NVIDIA RTX PRO 6000.

For NVIDIA H100 quota requests, see NVIDIA H100.

GPU quotas

To create Confidential VM instances with attached NVIDIA GPUs, you must have sufficient GPU quota in your Google Cloud project for the specific GPU type, region, and instance provisioning model that you want to use.

NVIDIA RTX PRO 6000

Confidential VM instances that are based on the G4 machine type use NVIDIA RTX PRO 6000 GPUs and consume GPU quotas based on the instance provisioning model:

• Standard (on-demand) VM instances: Consume the GPU_FAMILY:NVIDIA_RTX_PRO_6000 quota.

• Spot VM and Flex-start VM instances: Consume the PREEMPTIBLE_NVIDIA_RTX_PRO_6000_GPUS quota.

Quota requests for NVIDIA RTX PRO 6000 GPUs follow the Google Cloud process. For more information, see View and manage quotas.

Note: If you want to use committed use discounts with G4 instances, you must have committed GPU quota (COMMITTED_NVIDIA_RTX_PRO_6000_GPUS) in your project. This quota is required when purchasing the commitment, not when creating the instance. For more information, see Commitment quotas.

NVIDIA H100

Confidential VM instances that are based on the A3 High machine type use NVIDIA H100 GPUs. You need sufficient quota in the following quota types to create a Confidential VM instance with GPU successfully:

• Preemptible quota for the GPU models that you want to create in each region.

• Global quota for the total number of GPUs of all types in all regions.

To request a quota increase, complete the following instructions based on the type of quota you need.

Preemptible quota

To request a regional preemptible NVIDIA H100 GPUs quota increase, do the following:

1. In the Google Cloud console, go to the Quotas page.

   Go to Quotas

2. In the Filter box, enter PREEMPTIBLE_NVIDIA_H100_GPUS, and then press the Enter or Return key.

3. In the Dimensions column of the table, find the row with the region whose quota you want to increase.

4. In that row, click More actions, and then click Edit quota.

5. In the Quota changes pane, enter the number of GPUs you want in the New value box.

6. Click Submit request.

Global quota

To request a global quota increase, do the following:

1. In the Google Cloud console, go to the Quotas page.

   Go to Quotas

2. In the Filter box, enter GPUS_ALL_REGIONS, and then press the Enter or Return key.

3. In the resulting row, click More actions, and then click Edit quota.

4. In the Quota changes pane, enter the number of GPUs you want in the New value box.

5. Click Submit request.

What happens after a quota request

If your quota request is successful, you're sent an approval email. Wait about 15 minutes after you receive the email, and then refresh the Quotas page to check for the updated quota. If the quota still hasn't been updated after 15 minutes, contact Cloud Customer Care.

If your quota request is denied, you might receive an email explaining the next steps you can take. To reapply for more quota, follow the instructions in the email.