Capacity overview

This document provides an overview of how to obtain capacity and quota for each consumption option in Cluster Director.

Cluster Director supports several consumption options to help you get and use compute resources. Understanding the quota, reservation, and billing requirements for each option helps you plan capacity and avoid provisioning delays when you create clusters.

How to obtain capacity

The following table describes how you can obtain capacity for each consumption option:

Consumption option Process for obtaining capacity Pricing implications
Future reservations for more than 90 days (for capacity blocks)

To get future reservation resources, the process is as follows:

  1. To reserve capacity, contact your account team. You can request compute instances and, optionally, a Hyperdisk pool.
  2. Google increases your quota, and then provisions your requested resources at your specified start date and for your specified duration.
  3. When you create a cluster from a template or as a custom cluster, select the Use reservation consumption option and then specify your reservation. Cluster Director creates the cluster from your reserved capacity.
You pay for the entire reservation period, whether you use the reserved resources or not. For more information, see the pricing for reservations and Hyperdisk pools.
Future reservations for up to 90 days (in calendar mode)

To get future reservation resources, the process is as follows:

  1. Search for available capacity and reserve resources by using the Google Cloud console, gcloud CLI, or Compute Engine API.
  2. No quota is charged and no action is required from you.
  3. When you create a cluster from a template or as a custom cluster, select the Use reservation consumption option and then specify your reservation. Cluster Director creates the cluster from your reserved capacity.
You're charged for the entire reservation period, whether or not you use the reserved resources for the entire period. For more information, see Dynamic Workload Scheduler pricing.
Flex-start

For this consumption option, no reservation is required. To get Flex-start resources, the process is as follows:

  1. Request preemptible GPU quota or TPU quota for the machine type that you want to use.
  2. When you create a cluster from a template or as a custom cluster, select the Use Flex-start consumption option. When your requested capacity becomes available, Cluster Director provisions your cluster. You obtain resources for up to seven days.
You're charged when the resources are in use. Resources that you provision by using Flex-start receive discounts through Dynamic Workload Scheduler pricing.
Spot

For this consumption option, no reservation is required. To get Spot resources, the process is as follows:

  1. Request preemptible CPU quota, GPU quota, or TPU quota for the machine type that you want to use.
  2. For GPU or CPU instances, view resource availability in the region or zone where you want to create compute instances.
  3. When you create a cluster from a template or as a custom cluster, select the Use Spot consumption option. Cluster Director provisions your cluster, but Compute Engine can preempt the Spot VMs in your cluster at any time.
You're charged when the resources are in use. Spot VMs receive discounts through Spot VMs pricing.
On-demand

For this consumption option, no reservation is required. To get on-demand resources, the process is as follows:

  1. If you don't have enough CPU quota or TPU quota for the resources that you plan to provision, then request a quota adjustment.
  2. When you create a cluster from a template or as a custom cluster, select the Use on-demand consumption option. Cluster Director provisions your cluster.
You're charged when the resources are in use. For more information, see VM instance pricing and Cloud TPU pricing.