To help you run proof-of-concept (POC) AI/ML workloads, this page provides an
overview of AI Hypercomputer tutorials that describe the complete
process of deploying common AI models on Google Cloud products.

These tutorials are designed for machine learning (ML) engineers, researchers,
platform administrators and operators, and data and AI specialists. These
tutorials assume that you have a foundational understanding of ML concepts and
proficiency with Google Cloud services, container orchestration, and
cluster management.

## Tutorial categories

The AI workload tutorials are organized into the following categories:

- [Run inference with vLLM and SGLang on GKE](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials.md.txt#inference): deploy and serve large language models (LLMs) for inference using the vLLM and SGLang serving frameworks on Google Kubernetes Engine (GKE).
- [Run LLM fine-tuning on GKE and Slurm](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials.md.txt#fine-tuning): fine-tune LLMs for specific tasks on GKE and Slurm clusters using distributed frameworks such as Hugging Face Accelerate, PyTorch Fully Sharded Data Parallel (FSDP), and Ray.
- [Run LLM training on Slurm clusters](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials.md.txt#training): train and pre-train LLMs on multi-node Slurm clusters using Cluster Toolkit and Hugging Face Accelerate.

### Run inference with vLLM and SGLang on GKE

These tutorials describe how to deploy and serve LLMs for inference using the
vLLM and SGLang serving frameworks on GKE. You learn to use
GKE's container orchestration capabilities for efficient
inference workloads. These tutorials cover accessing models using Hugging Face,
setting up GKE clusters (for example, in Autopilot
mode), handling credentials, and deploying vLLM or SGLang containers for
interaction with LLMs such as Gemma 4, Gemma 3, Llama 4,
and Qwen3.

### Run LLM fine-tuning on GKE and Slurm

These tutorials describe how to fine-tune LLMs for specific tasks across various
Google Cloud cluster types, including GKE and Slurm. For
example, you can fine-tune Gemma 3 on multi-node and multi-GPU
GKE clusters (for example, using A4 VM instances with NVIDIA B200
GPUs) and Slurm clusters. You create custom VM images, configure RDMA networks,
and run distributed fine-tuning jobs using Hugging Face Accelerate and FSDP for
text tasks, or the Ray framework for multimodal vision tasks.

### Run LLM training on Slurm clusters

These tutorials describe how to train or pre-train LLMs on high-performance
clusters. For example, you learn to pre-train models like Qwen2 on multi-node
and multi-GPU Slurm clusters with A4 virtual machines. You deploy Slurm
clusters using the Google Cloud Cluster Toolkit, create
custom VM images, configure shared Filestore instances, configure
high-speed RDMA networking, and run distributed pre-training jobs with Hugging
Face Accelerate.

## What's next

Explore the AI Hypercomputer tutorials:

- [Serve DeepSeek-R1 671B on GKE with multi-host vLLM on A4 VMs](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/gpu/serve-deepseek-r1-671b-a4-gke-multi-host-vllm.md.txt)
- [Serve Qwen3.8-2.4T on GKE with multi-host PD disaggregation using Dynamo and SGLang on A4 VMs](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/gpu/serve-qwen3-8-2-4t-a4-gke-multi-host-sglang.md.txt)
- [Serve Llama 3.1 405B on GKE with PD disaggregation using Dynamo and SGLang on A4 VMs](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/gpu/serve-llama-3-1-405b-a4-gke-sglang.md.txt)
- [Serve Qwen3-Coder-480B with multi-host SGLang TorchTPU on TPU7x](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/serve-qwen3-coder-gke-ironwood-multi-host-torchtpu.md.txt)
- [Serve Qwen3-Coder-30B-A3B with multi-host SGLang TorchTPU on TPU v6e](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/serve-qwen3-coder-gke-v6e-multi-host-torchtpu.md.txt)
- [Serve Qwen3.5-397B with multi-host vLLM TorchTPU on TPU7x](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/serve-qwen3-5-397b-ironwood-multi-host-vllm-torchtpu.md.txt)
- [Serve Qwen3-30B-A3B with multi-host vLLM TorchTPU on TPU v6e](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/serve-qwen3-30b-v6e-multi-host-vllm-torchtpu.md.txt)
- [Serve Qwen3.5-397B with vLLM TorchTPU on TPU7x](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/serve-qwen3-5-397b-ironwood-vllm-torchtpu.md.txt)
- [Serve Qwen3-30B-A3B with vLLM TorchTPU on TPU v6e](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/serve-qwen3-30b-v6e-vllm-torchtpu.md.txt)
- [Serve Gemma 4 26B with multi-host vLLM TorchTPU on Trillium TPUs](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/serve-gemma4-26b-gke-trillium-vllm.md.txt)
- [Fine-tune Gemma 4 on a multi-host A4 GKE cluster](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/gpu/gemma4-finetune-a4-gke-multi-host-cluster.md.txt)
- [Fine-tune Gemma 4 on an A4 GKE cluster](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/gpu/gemma4-finetune-a4-gke-cluster.md.txt)
- [Run multi-host RL training for Gemma 4 26B on TPU v6e](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/run-gemma4-26b-rl-maxtext.md.txt)
- [Run SFT for Gemma 4 31B on multi-host TPU v6e](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/run-gemma4-31b-sft-maxtext.md.txt)
- [Run multi-host RL training for Qwen3-30B-A3B on TPU v6e](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/run-qwen3-30b-a3b-rl-maxtext.md.txt)
- [Fine-tune Gemma 3 on a multi-host A4 GKE cluster](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/gpu/gemma3-finetune-a4-gke-multi-host-cluster.md.txt)
- [Run supervised fine-tuning on a TPU VM with MaxText](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/run-sft-v6e-8-tpu-vm-maxtext.md.txt)
- [Run RL training on a v6e-8 TPU VM](https://docs.cloud.google.com/ai-hypercomputer/docs/tutorials/tpu/run-rl-v6e-8-tpu-vm.md.txt)