Migration job metrics

Database Migration Service collects and displays migration job metrics that represent the health and progress of your continuous data migration to an AlloyDB for PostgreSQL cluster. This page describes the following areas associated with migration job metrics:

Metrics available on the migration job details page

The migration job details page shows diagrams and tables that can help you understand the current state and progress of your migration job. You can view metrics for all databases included in your migration job or only the databases that you selected for migration.

Example diagrams for migration job metrics
      Database Migration Service.
Figure 1. Sample observability diagrams in Database Migration Service. (click to enlarge)
Example diagrams for migration job metrics
      Database Migration Service.

Expand the following sections to learn more about each diagram and its associated metric.

Total destination storage usage

The Total destination storage usage diagram uses the AlloyDB for PostgreSQL cluster/storage/bytes_used metric to show how much data (in bytes) is stored in all the databases in your destination AlloyDB for PostgreSQL cluster. You can use this information to estimate the progress of your migration job.

This metric is only available in the aggregated view. You can't filter the total storage usage per database.

Replication delay

The Replication delay diagram shows how far the destination AlloyDB for PostgreSQL cluster is behind the source database in bytes.

Use this metric when you consider performing a promotion of a continuous migration. Replication delay should be zero at the time of the promotion in order to avoid data loss. Note that this metric is only relevant in the change data capture (CDC) phase. For more information on job promotion, see Promote a migration.

This metric is available for each database included in your migration job, and in the aggregated view where it shows a summary for all databases included in your migration job.

View metrics on the migration job details page

To view metric diagrams on the migration job details page, perform the following steps:

  1. In the Google Cloud console, go to the Migration jobs page.

    Go to Migration jobs

  2. In the Jobs tab, click the display name of your migration job.

    The migration job details page opens.

  3. In the Databases section, you can view the name and status of each database included in your migration job.
  4. Click the Monitoring tab to see the metrics diagrams.
    • You can use the View menu to show aggregated data for all databases included in your migration job, or filter the information for specific databases.
    • You can also view each diagram directly in Cloud Monitoring. Click More chart options > View in Metrics Explorer.

Metrics available in Cloud Monitoring

The following table describes migration job metrics you can use to create charts in Metrics Explorer for AlloyDB for PostgreSQL migrations. For more information, see the complete Database Migration Service metrics reference.

You can also use the AlloyDB for PostgreSQL alloydb.googleapis.com/cluster/storage/bytes_used metric and compare it with the total size of your source databases to estimate the migration job progress.

Metric type Launch stage
Display name
Kind, Type, Unit
Monitored resources
Description
Labels
migration_job/initial_sync_complete BETA
Initial replication sync complete
GAUGE, BOOL, 
datamigration.googleapis.com/MigrationJob
Whether all databases on the destination DB instance have completed the initial sync and are replicating changes from the source.
database: Database name.
migration_job/max_replica_bytes_lag BETA
Max lag bytes of the migration job data
GAUGE, INT64, By
datamigration.googleapis.com/MigrationJob
Current replication lag, aggregated across all of the migration job's data. Sampled every 60 seconds. After sampling, data is not visible for up to 180 seconds.
database: Database name.
migration_job/max_replica_sec_lag BETA
Max lag in seconds of the migration job data
GAUGE, INT64, s
datamigration.googleapis.com/MigrationJob
Current replication lag, aggregated across all of the migration job's data. Sampled every 60 seconds. After sampling, data is not visible for up to 180 seconds.