> [!WARNING]
>
> This product is a Pre-GA offering, subject to the "Pre-GA Offerings Terms"
> in the General Service Terms section of the
> [Service Specific Terms](https://cloud.google.com/terms/service-terms#1),
> the "Agentic AI Services" terms in the
> [Service Specific Terms](https://cloud.google.com/terms/service-terms#1),
> and the [Additional Terms for Generative AI Preview Products](https://cloud.google.com/trustedtester/aitos).
> Pre-GA products and features may have limited support, and changes to pre-GA
> products and features may not be compatible with other pre-GA versions.
> For more information, see the
> [launch stage descriptions](https://cloud.google.com/products/#product-launch-stages).
>
>
> These Pre-GA products are in various stages of internal testing and review.
> As such, **do not use proprietary, sensitive, or other confidential data
> with these products**. These products are made available to Customers
> solely for limited testing and evaluation, and may not be used for commercial
> or production purposes.

Continuous tuning lets you continue tuning an already tuned model or model
checkpoint by adding more epochs or training examples. Using an already
tuned model or checkpoint as the base model allows for more efficient tuning
experimentation.

You can use continuous tuning for the following purposes:

- To tune with more data if an existing tuned model is underfitting.
- To boost performance or keep the model up to date with new data.
- To further customize an existing tuned model.

## Supported continuous tuning patterns

The following continuous tuning patterns are supported:

- Supervised fine-tuning → Reinforcement learning fine-tuning
- Reinforcement learning fine-tuning → Reinforcement learning fine-tuning

## Configure continuous tuning

You can configure a continuous tuning job in the Google Cloud console or by using
the REST API.

### Console

To configure a continuous tuning job in the Google Cloud console:

1. In the Google Cloud console, go to the **Models \> Tuning**
   page.

   [Go to **Tuning**](https://console.cloud.google.com/agent-platform/tuning)
2. Click **Create tuned model**.
3. Under **Tuning method** , select **Reinforcement learning fine
   tuning**.
4. In the **Base model** section, select **Tune a pre-tuned
   model**.
5. Click **Select model**, choose your previously tuned model, and select a version or checkpoint to continue tuning from.
6. Proceed through the remaining steps to configure your reward functions, training dataset, and hyperparameters. For more information, see the [Google Cloud console quickstart](https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/tuning/reinforcement-tuning/quick-start-console.md.txt).

### REST

To configure a continuous tuning job programmatically, include a
`preTunedModel` block in the request body that points to the
previously tuned model (and, optionally, a specific checkpoint). The
rest of the request follows the same schema as a new reinforcement
learning fine-tuning job.

```json
{
  "description": "DESCRIPTION",
  "tunedModelDisplayName": "TUNED_MODEL_DISPLAY_NAME",
  "reinforcementTuningSpec": {
    "trainingDatasetUri": "TRAINING_DATASET",
    "validationDatasetUri": "VALIDATION_DATASET",
    "hyperParameters": HYPERPARAMETERS,
    "singleRewardConfig": REWARD_CONFIG
  },
  "preTunedModel": {
    "tunedModelName": "projects/PROJECT_ID/locations/LOCATION_ID/models/PRETUNED_MODEL_ID",
    "checkpointId": "CHECKPOINT_ID"
  }
}
```

Replace the following:

- `DESCRIPTION`: a description of the tuning job. Optional.
- `TUNED_MODEL_DISPLAY_NAME`: display name for the tuned model.
- `TRAINING_DATASET`: Cloud Storage URI of the training dataset JSONL file.
- `VALIDATION_DATASET`: Cloud Storage URI of the validation dataset JSONL file. Optional.
- `HYPERPARAMETERS`: hyperparameter configuration for the continuous tuning job. For details, see the [Hyperparameters](https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/tuning/reinforcement-tuning/reinforcement-tuning-job/hyperparameters.md.txt) page.
- `REWARD_CONFIG`: reward configuration. For details, see the [Reward functions](https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/tuning/reinforcement-tuning/reinforcement-tuning-job/reward-functions.md.txt) page.
- `PROJECT_ID`: your Google Cloud project ID.
- `LOCATION_ID`: the location ID.
- `PRETUNED_MODEL_ID`: the model ID of the previously tuned model to continue from.
- `CHECKPOINT_ID`: the ID of a specific checkpoint of the previously tuned model. Optional; if omitted, the latest checkpoint of the pretuned model is used.

## What's next

- [Prepare a tuning dataset](https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/tuning/reinforcement-tuning/reinforcement-tuning-job/tuning-dataset.md.txt) for the continuous tuning job.
- [Configure hyperparameters](https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/tuning/reinforcement-tuning/reinforcement-tuning-job/hyperparameters.md.txt) and [reward functions](https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/tuning/reinforcement-tuning/reinforcement-tuning-job/reward-functions.md.txt) for the continuous tuning job.
- [Monitor job status and metrics](https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/tuning/reinforcement-tuning/reinforcement-tuning-job/job-status-metrics-monitoring.md.txt) while continuous tuning runs.