Track parameters and metrics for custom training jobs: Notebook

This notebook demonstrates how to use Agent Platform SDK for Python to track metrics and parameters for Agent Platform custom training jobs, and how to perform detailed analysis using this data.

Notebook:

To see an example of tracking parameters and metrics for a custom training job, run the "Track parameters and metrics for custom training job" notebook in one of the following environments:

Open in Colab | Open in Colab Enterprise | Open in Agent Platform Workbench | View on GitHub

This tutorial uses the following Google Cloud ML services and resources:

• Agent Platform dataset
• Agent Platform model
• Agent Platform endpoint
• Agent Platform custom training Job
• Agent Platform Experiments

The steps performed include:

1. Track training parameters and prediction metrics for a custom training job.
2. Extract and perform analysis for all parameters and metrics within a Agent Platform Experiments.

Relevant content

• Vertex ML Metadata
• Custom training overview
• Endpoint
• Create and manage experiment runs