Create a Google Kubernetes job template

Use the gke-job-template module to create a Kubernetes job template file. You can submit this file to your cluster as-is or use it as a template for further customization.

This module works with one or more gke-node-pool modules. The module configures the job to run on any of the specified node pools.

For the complete list of inputs and outputs, see the gke-job-template module in the Cluster Toolkit GitHub repository.

Before you begin

Before you begin, verify that you meet the following requirements:

  • You have installed and configured Cluster Toolkit. For installation instructions, see Set up Cluster Toolkit.
  • You have an existing cluster blueprint. You can use and modify an existing blueprint or create one from scratch. For a working example of a blueprint configured for the gke-job-template module, see the community/examples/hpc-gke.yaml file. For more information about creating and customizing blueprints, see Cluster blueprint.
  • To view a complete list of blueprints that support the gke-job-template module, go to the Cluster blueprint catalog page, click the Select software or resource menu and then select Google Kubernetes Engine job template.
  • In your blueprint, you must have added the gke-node-pool module.

Required roles

To get the permissions that you need to create Google Kubernetes Engine job templates, ask your administrator to grant you the Kubernetes Engine Admin (roles/container.admin) IAM role on your project. For more information about granting roles, see Manage access to projects, folders, and organizations.

You might also be able to get the required permissions through custom roles or other predefined roles.

Create a job template

To create a GKE job template, add the gke-job-template module to your blueprint. You must specify which node pools the job can use by referencing them in the use field.

The following example creates a job template that uses the gke-node-pool module. The example also requests the instructions output, which provides the kubectl commands needed to submit the job.

  - id: job-template
    source: modules/compute/gke-job-template
    use: [compute_pool]
    settings:
      node_count: 3
    outputs: [instructions]

To see a detailed example of how to deploy GKE for high performance computing workloads, see the community/examples/hpc-gke.yaml file in the Cluster Toolkit repository on GitHub.

Configure storage options

The gke-job-template module supports the following storage configuration options:

  • Filestore: A shared file system mounted between pods and nodes.

  • Ephemeral storage: Pod-level storage options, including the following:

    • Memory-backed emptyDir: uses the node's RAM (tmpfs) to provide high-speed, low-latency storage for temporary data that does not persist across pod restarts.
    • Local SSD-backed emptyDir: uses physically attached NVMe SSDs to provide high-performance, high-throughput ephemeral storage suitable for demanding scratch space requirements.
    • SSD persistent disk-backed ephemeral volume: uses SSD-backed persistent disks (PD-SSD) to provide reliable ephemeral storage with consistent performance for disk-intensive temporary tasks.
    • Balanced persistent disk-backed ephemeral volume: uses balanced persistent disks (PD-Balanced) to provide a cost-effective storage option that balances performance and capacity for general-purpose ephemeral needs.

For examples of how to use Filestore and ephemeral storage with this module, see the examples/storage-gke.yaml blueprint in the GitHub repository.

Configure resource requests

When you reference one or more gke-node-pool modules in the use field, the module automatically populates the requested resources to achieve one pod per node, while leaving additional space for required system pods.

To override this behavior and specify a custom CPU requirement, use the requested_cpu_per_pod setting.

What's next