gcloud beta metastore services migrations start

NAME
gcloud beta metastore services migrations start - start the migration from a Dataproc Metastore service to Lakehouse runtime catalog(s)
SYNOPSIS
gcloud beta metastore services migrations start (SERVICE : --location=LOCATION) [--async] [--conflict-policy=CONFLICT_POLICY; default="skip"] [--dry-run] [--mode=MODE; default="backfill"] [--report-path=REPORT_PATH] [--hive-catalog=HIVE_CATALOG : --hive-databases=[HIVE_DATABASES,…]; default="*"] [--iceberg-catalog=ICEBERG_CATALOG : --iceberg-namespaces=[ICEBERG_NAMESPACES,…]; default="*"] [GCLOUD_WIDE_FLAG …]
DESCRIPTION
(BETA) Start the migration from a Dataproc Metastore service to Lakehouse runtime catalog(s).

If run asynchronously with --async, exits after printing the operation name that can be used to poll the status of the migration operation via: 

gcloud metastore operations describe
POSITIONAL ARGUMENTS
Service resource - The Dataproc Metastore service to start the migration on. The arguments in this group can be used to specify the attributes of this resource. (NOTE) Some attributes are not given arguments in this group but can be set in other ways.

To set the project attribute:

  • provide the argument service on the command line with a fully specified name;
  • provide the argument --project on the command line;
  • set the property core/project.

This must be specified.

SERVICE
ID of the service or fully qualified identifier for the service.

To set the service attribute:

  • provide the argument service on the command line.

This positional argument must be specified if any of the other arguments in this group are specified.

--location=LOCATION
The location of the Dataproc Metastore service.

If not specified, will use default metastore/location. To set the location attribute:

  • provide the argument service on the command line with a fully specified name;
  • provide the argument --location on the command line;
  • set the property metastore/location.
FLAGS
--async
Return immediately, without waiting for the operation in progress to complete.
--conflict-policy=CONFLICT_POLICY; default="skip"
The policy to handle conflicts when migrating resources to Lakehouse. CONFLICT_POLICY must be one of:
overwrite
Update resources that already exist in the target catalog.
skip
Skip migrating resources that already exist in the target catalog.
--dry-run
If true, performs discovery of requested resources and analysis against the target catalog to come up with a plan for each resource (e.g. Create, Update, Skip, etc.). No metadata is actually migrated.
--mode=MODE; default="backfill"
The execution mode of the migration. MODE must be (only one value is supported):
backfill
Performs the metadata migration of requested resources. The migration completes once the backfill is finished.
--report-path=REPORT_PATH
The Cloud Storage path where the backfill or dry run report should be written. If not provided, the report will be generated in the service's artifacts bucket. Format: "gs://path/to/folder".
Configuration for migrating Hive tables to a BigLake Hive catalog.
--hive-catalog=HIVE_CATALOG
The target catalog for migrated databases and tables. Format: "projects/{project_id_or_number}/catalogs/{catalog_id}"

This flag argument must be specified if any of the other arguments in this group are specified.

--hive-databases=[HIVE_DATABASES,…]; default="*"
Comma-separated list of databases to migrate to the Hive catalog. Defaults to "" (migrate all databases). Note: If Iceberg tables exist in these databases, they will only be migrated if --iceberg-catalog is also specified.
Configuration for migrating Iceberg tables to a BigLake Iceberg REST catalog.
--iceberg-catalog=ICEBERG_CATALOG
The target catalog for migrated Iceberg metadata. Format: "projects/{project_id_or_number}/catalogs/{catalog_id}"

This flag argument must be specified if any of the other arguments in this group are specified.

--iceberg-namespaces=[ICEBERG_NAMESPACES,…]; default="*"
Comma-separated list of namespaces to migrate to the Iceberg REST catalog. Defaults to "" (migrate all namespaces). Note: If Hive tables exist in these namespaces, they will only be migrated if --hive-catalog is also specified.
GCLOUD WIDE FLAGS
These flags are available to all commands: --access-token-file, --account, --billing-project, --configuration, --flags-file, --flatten, --format, --help, --impersonate-service-account, --log-http, --project, --quiet, --trace-token, --user-output-enabled, --verbosity.

Run $ gcloud help for details.

API REFERENCE
This command uses the metastore/v1beta API. The full documentation for this API can be found at: https://cloud.google.com/dataproc-metastore/docs
NOTES
This command is currently in beta and might change without notice. This variant is also available: 
gcloud alpha metastore services migrations start