Create custom organization policy constraints

This page shows you how to use Organization Policy Service custom constraints to restrict specific operations on the following Google Cloud resources:

  • datamigration.googleapis.com/ConnectionProfile
  • datamigration.googleapis.com/ConversionWorkspace
  • datamigration.googleapis.com/MigrationJob
  • datamigration.googleapis.com/PrivateConnection

To learn more about Organization Policy, see Custom organization policies.

About organization policies and constraints

The Google Cloud Organization Policy Service gives you centralized, programmatic control over your organization's resources. As the organization policy administrator, you can define an organization policy, which is a set of restrictions called constraints that apply to Google Cloud resources and descendants of those resources in the Google Cloud resource hierarchy. You can enforce organization policies at the organization, folder, or project level.

Organization Policy provides built-in managed constraints for various Google Cloud services. However, if you want more granular, customizable control over the specific fields that are restricted in your organization policies, you can also create custom constraints and use those custom constraints in an organization policy.

Policy inheritance

By default, organization policies are inherited by the descendants of the resources on which you enforce the policy. For example, if you enforce a policy on a folder, Google Cloud enforces the policy on all projects in the folder. To learn more about this behavior and how to change it, refer to Hierarchy evaluation rules.

Benefits

You can use custom organization policies to enforce specific security policies on your Database Migration Service resources. For example, you can restrict the types of migration jobs, the engine types for connection profiles, or the networks used for private connections. These custom organization policies and restrictions help ensure compliance and governance across your organization.

Limitations

  • Policy changes don't apply retroactively to existing Database Migration Service resources.
  • An existing resource configuration remains valid even if it has non-compliant values, unless it's updated.
  • Custom constraint evaluation might add a small latency to resource creation and update requests.

Before you begin

  1. Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

  2. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

    Roles required to select or create a project

    • Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
    • Create a project: To create a project, you need the Project Creator role (roles/resourcemanager.projectCreator), which contains the resourcemanager.projects.create permission. Learn how to grant roles.

    Go to project selector

  3. Verify that billing is enabled for your Google Cloud project.

  4. Install the Google Cloud CLI.

  5. If you're using an external identity provider (IdP), you must first sign in to the gcloud CLI with your federated identity.

  6. To initialize the gcloud CLI, run the following command: 

    gcloud init

  7. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

    Roles required to select or create a project

    • Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
    • Create a project: To create a project, you need the Project Creator role (roles/resourcemanager.projectCreator), which contains the resourcemanager.projects.create permission. Learn how to grant roles.

    Go to project selector

  8. Verify that billing is enabled for your Google Cloud project.

  9. Install the Google Cloud CLI.

  10. If you're using an external identity provider (IdP), you must first sign in to the gcloud CLI with your federated identity.

  11. To initialize the gcloud CLI, run the following command: 

    gcloud init
  12. Ensure that you know your organization ID.

Required roles

To get the permissions that you need to manage custom organization policies, ask your administrator to grant you the Organization Policy Administrator (roles/orgpolicy.policyAdmin) IAM role on the organization resource. For more information about granting roles, see Manage access to projects, folders, and organizations.

You might also be able to get the required permissions through custom roles or other predefined roles.

Set up a custom constraint

A custom constraint is defined in a YAML file by the resources, methods, conditions, and actions that are supported by the service on which you are enforcing the organization policy. Conditions for your custom constraints are defined using Common Expression Language (CEL). For more information about how to build conditions in custom constraints using CEL, see the CEL section of Creating and managing custom constraints.

Console

To create a custom constraint, do the following:

  1. In the Google Cloud console, go to the Organization policies page.

    Go to Organization policies

  2. From the project picker, select the project that you want to set the organization policy for.
  3. Click Custom constraint.
  4. In the Display name box, enter a human-readable name for the constraint. This name is used in error messages and can be used for identification and debugging. Don't use PII or sensitive data in display names because this name could be exposed in error messages. This field can contain up to 200 characters.
  5. In the Constraint ID box, enter the name that you want for your new custom constraint. A custom constraint can only contain letters (including upper and lowercase) or numbers, for example custom.disableGkeAutoUpgrade. This field can contain up to 70 characters, not counting the prefix (custom.), for example, organizations/123456789/customConstraints/custom. Don't include PII or sensitive data in your constraint ID, because it could be exposed in error messages.
  6. In the Description box, enter a human-readable description of the constraint. This description is used as an error message when the policy is violated. Include details about why the policy violation occurred and how to resolve the policy violation. Don't include PII or sensitive data in your description, because it could be exposed in error messages. This field can contain up to 2000 characters.
  7. In the Resource type box, select the name of the Google Cloud REST resource containing the object and field that you want to restrict—for example, container.googleapis.com/NodePool. Most resource types support up to 20 custom constraints. If you attempt to create more custom constraints, the operation fails.
  8. Under Enforcement method, select whether to enforce the constraint on a REST CREATE method or on both CREATE and UPDATE methods. If you enforce the constraint with the UPDATE method on a resource that violates the constraint, changes to that resource are blocked by the organization policy unless the change resolves the violation.

    9. Not all Google Cloud services support both methods. To see supported methods for each service, find the service in Supported services.

  9. To define a condition, click Edit condition.
    1. In the Add condition panel, create a CEL condition that refers to a supported service resource, for example, resource.management.autoUpgrade == false. This field can contain up to 1000 characters. For details about CEL usage, see Common Expression Language. For more information about the service resources you can use in your custom constraints, see Custom constraint supported services.
    2. Click Save.
  10. Under Action, select whether to allow or deny the evaluated method if the condition is met.

    11. The deny action means that the operation to create or update the resource is blocked if the condition evaluates to true.

    The allow action means that the operation to create or update the resource is permitted only if the condition evaluates to true. Every other case except ones explicitly listed in the condition is blocked.

  11. Click Create constraint.

    12. When you have entered a value into each field, the equivalent YAML configuration for this custom constraint appears on the right.

gcloud

  1. To create a custom constraint, create a YAML file using the following format: 
    2.       name: organizations/ORGANIZATION_ID/customConstraints/CONSTRAINT_NAME
      resourceTypes:
      - RESOURCE_NAME
      methodTypes:
      - CREATE
    - UPDATE     
      condition: "CONDITION"
      actionType: ACTION
      displayName: DISPLAY_NAME
      description: DESCRIPTION

    Replace the following:

    • ORGANIZATION_ID: your organization ID, such as 123456789.
    • CONSTRAINT_NAME: the name that you want for your new custom constraint. A custom constraint can only contain letters (including upper and lowercase) or numbers, for example, custom.restrictDmsMigrationJobType. This field can contain up to 70 characters.
    • RESOURCE_NAME: the fully qualified name of the Google Cloud resource containing the object and field that you want to restrict. For example, datamigration.googleapis.com/MigrationJob.
    • CONDITION: a CEL condition that is written against a representation of a supported service resource. This field can contain up to 1000 characters. For example, "resource.type != 'CONTINUOUS'".

      • For more information about the resources available to write conditions against, see Supported resources.

    • ACTION: the action to take if the condition is met. Possible values are ALLOW and DENY.

      • The allow action means that if the condition evaluates to true, the operation to create or update the resource is permitted. This also means that every other case except the one explicitly listed in the condition is blocked.

      The deny action means that if the condition evaluates to true, the operation to create or update the resource is blocked.

    • DISPLAY_NAME: a human-friendly name for the constraint. This field can contain up to 200 characters.
    • DESCRIPTION: a human-friendly description of the constraint to display as an error message when the policy is violated. This field can contain up to 2000 characters.
  2. After you have created the YAML file for a new custom constraint, you must set it up to make it available for organization policies in your organization. To set up a custom constraint, use the gcloud org-policies set-custom-constraint command: 
    3.         gcloud org-policies set-custom-constraint CONSTRAINT_PATH

    Replace CONSTRAINT_PATH with the full path to your custom constraint file. For example, /home/user/customconstraint.yaml.

    After this operation is complete, your custom constraints are available as organization policies in your list of Google Cloud organization policies.

  3. To verify that the custom constraint exists, use the gcloud org-policies list-custom-constraints command: 
    4.       gcloud org-policies list-custom-constraints --organization=ORGANIZATION_ID

    Replace ORGANIZATION_ID with the ID of your organization resource.

    For more information, see Viewing organization policies.

Enforce a custom organization policy

You can enforce a constraint by creating an organization policy that references it, and then applying that organization policy to a Google Cloud resource.

Console

  1. In the Google Cloud console, go to the Organization policies page.

    Go to Organization policies

  2. From the project picker, select the project that you want to set the organization policy for.
  3. From the list on the Organization policies page, select your constraint to view the Policy details page for that constraint.
  4. To configure the organization policy for this resource, click Manage policy.
  5. On the Edit policy page, select Override parent's policy.
  6. Click Add a rule.
  7. In the Enforcement section, select whether this organization policy is enforced or not.
  8. Optional: To make the organization policy conditional on a tag, click Add condition. Note that if you add a conditional rule to an organization policy, you must add at least one unconditional rule or the policy cannot be saved. For more information, see Setting an organization policy with tags.
  9. Click Test changes to simulate the effect of the organization policy. For more information, see Test organization policy changes with Policy Simulator.
  10. To enforce the organization policy in dry-run mode, click Set dry run policy. For more information, see Create an organization policy in dry-run mode.
  11. After you verify that the organization policy in dry-run mode works as intended, set the live policy by clicking Set policy.

gcloud

  1. To create an organization policy with boolean rules, create a policy YAML file that references the constraint: 
    2.         name: projects/PROJECT_ID/policies/CONSTRAINT_NAME
        spec:
          rules:
          - enforce: true
        
        dryRunSpec:
          rules:
          - enforce: true

    Replace the following:

    • PROJECT_ID: the project that you want to enforce your constraint on.
    • CONSTRAINT_NAME: the name you defined for your custom constraint. For example, custom.restrictDmsMigrationJobType.
  2. To enforce the organization policy in dry-run mode, run the following command with the dryRunSpec flag: 
    3.         gcloud org-policies set-policy POLICY_PATH \
          --update-mask=dryRunSpec

    Replace POLICY_PATH with the full path to your organization policy YAML file. The policy requires up to 15 minutes to take effect.

  3. After you verify that the organization policy in dry-run mode works as intended, set the live policy with the org-policies set-policy command and the spec flag: 
    4.         gcloud org-policies set-policy POLICY_PATH \
          --update-mask=spec

    Replace POLICY_PATH with the full path to your organization policy YAML file. The policy requires up to 15 minutes to take effect.

Test the custom organization policy

The following example creates a custom constraint and policy that blocks the creation of Database Migration Service migration jobs if their type is not set to CONTINUOUS.

Before you begin, make note of the following:

  • Your organization ID
  • A project ID

Create the constraint

  1. Save the following file as constraint-dms-migrationjob-type.yaml:

    name: organizations/ORGANIZATION_ID/customConstraints/custom.restrictDmsMigrationJobType
resourceTypes:
- datamigration.googleapis.com/MigrationJob
methodTypes:
- CREATE
- UPDATE
condition: "resource.type != 'CONTINUOUS'"
actionType: DENY
displayName: Restrict migration job type
description: All new migration jobs must be of type CONTINUOUS

    This defines a constraint where every new or updated migration job must have a type equal to CONTINUOUS.

  2. Apply the constraint:

    gcloud org-policies set-custom-constraint ~/constraint-dms-migrationjob-type.yaml

  3. Verify that the constraint exists:

    gcloud org-policies list-custom-constraints --organization=ORGANIZATION_ID

Create the policy

  1. Save the following file as policy-deny-dms-migrationjob-type.yaml:

    name: projects/PROJECT_ID/policies/custom.restrictDmsMigrationJobType
spec:
  rules:
  - enforce: true

    Replace PROJECT_ID with your project ID.

  2. Apply the policy:

    gcloud org-policies set-policy ~/policy-deny-dms-migrationjob-type.yaml

Test the policy

To test the policy, try to create a Database Migration Service migration job with type ONE_TIME:

# This command is a conceptual example. You need to provide valid IDs and other flags.
# Replace <VAR> placeholders with actual values.
gcloud database-migration migration-jobs create my-one-time-mig --region=<VAR>REGION</VAR> --type=ONE_TIME --display-name="One Time Migration" --source=<VAR>SOURCE_CP</VAR> --destination=<VAR>DEST_CP</VAR> ...

The output includes an error similar to the following:

Operation denied by custom org policies: ["customConstraints/custom.restrictDmsMigrationJobType": "All new migration jobs must be of type CONTINUOUS"]

Example custom organization policies for common use cases

This table provides syntax examples for some common custom constraints.

Description Constraint syntax
Restrict migration job type

Ensures all new migration jobs are continuous.

      name: organizations/ORGANIZATION_ID/customConstraints/custom.restrictDmsMigrationJobType
      resourceTypes:
      - datamigration.googleapis.com/MigrationJob
      methodTypes:
      - CREATE
      - UPDATE
      condition: "resource.type != 'CONTINUOUS'"
      actionType: DENY
      displayName: Restrict migration job type
      description: All new migration jobs must be of type CONTINUOUS
Restrict connection profile engines

Ensures only PostgreSQL connection profiles can be created.

Note: The exact condition depends on the structure of the generated CEL proto for ConnectionProfile.

      name: organizations/ORGANIZATION_ID/customConstraints/custom.restrictDmsToPostgres
      resourceTypes:
      - datamigration.googleapis.com/ConnectionProfile
      methodTypes:
      - CREATE
      # Example condition, validate against actual CEL proto fields.
      condition: "!has(resource.postgresql)"
      actionType: DENY
      displayName: Restrict connection profiles to PostgreSQL
      description: Only PostgreSQL connection profiles can be created.
Restrict conversion workspace source engine

Ensures that conversion workspaces can only be created with Oracle as the source engine.

Note: The exact condition depends on the structure of the generated CEL proto for ConversionWorkspace.

      name: organizations/ORGANIZATION_ID/customConstraints/custom.restrictDmsCwSourceEngine
      resourceTypes:
      - datamigration.googleapis.com/ConversionWorkspace
      methodTypes:
      - CREATE
      - UPDATE
      # Example condition, validate against actual CEL proto fields.
      condition: "resource.source.engine != 'ORACLE'"
      actionType: DENY
      displayName: Restrict conversion workspace source engine
      description: Conversion workspaces must use Oracle as the source engine.

Database Migration Service supported resources

The following table lists the Database Migration Service resources that you can reference in custom constraints.

Resource Field
datamigration.googleapis.com/ConnectionProfile resource.alloydb.clusterId
resource.alloydb.settings.databaseVersion
resource.alloydb.settings.encryptionConfig.kmsKeyName
resource.alloydb.settings.initialUser.user
resource.alloydb.settings.primaryInstanceSettings.databaseFlags
resource.alloydb.settings.primaryInstanceSettings.instanceNetworkConfig.authorizedExternalNetworks.cidrRange
resource.alloydb.settings.primaryInstanceSettings.instanceNetworkConfig.enableOutboundPublicIp
resource.alloydb.settings.primaryInstanceSettings.instanceNetworkConfig.enablePublicIp
resource.alloydb.settings.primaryInstanceSettings.machineConfig.cpuCount
resource.alloydb.settings.primaryInstanceSettings.machineConfig.machineType
resource.alloydb.settings.vpcNetwork
resource.cloudsql.settings.activationPolicy
resource.cloudsql.settings.autoStorageIncrease
resource.cloudsql.settings.availabilityType
resource.cloudsql.settings.cmekKeyName
resource.cloudsql.settings.collation
resource.cloudsql.settings.databaseFlags
resource.cloudsql.settings.databaseVersion
resource.cloudsql.settings.databaseVersionName
resource.cloudsql.settings.dataCacheConfig.dataCacheEnabled
resource.cloudsql.settings.dataDiskProvisionedIops
resource.cloudsql.settings.dataDiskProvisionedThroughput
resource.cloudsql.settings.dataDiskSizeGb
resource.cloudsql.settings.dataDiskType
resource.cloudsql.settings.edition
resource.cloudsql.settings.ipConfig.allocatedIpRange
resource.cloudsql.settings.ipConfig.authorizedNetworks.expireTime
resource.cloudsql.settings.ipConfig.authorizedNetworks.label
resource.cloudsql.settings.ipConfig.authorizedNetworks.ttl
resource.cloudsql.settings.ipConfig.authorizedNetworks.value
resource.cloudsql.settings.ipConfig.enableIpv4
resource.cloudsql.settings.ipConfig.privateNetwork
resource.cloudsql.settings.ipConfig.requireSsl
resource.cloudsql.settings.secondaryZone
resource.cloudsql.settings.sourceId
resource.cloudsql.settings.storageAutoResizeLimit
resource.cloudsql.settings.tier
resource.cloudsql.settings.zone
resource.displayName
resource.mysql.cloudSqlId
resource.mysql.host
resource.mysql.port
resource.mysql.ssl.sslFlags
resource.mysql.ssl.type
resource.mysql.username
resource.name
resource.oracle.forwardSshConnectivity.hostname
resource.oracle.forwardSshConnectivity.port
resource.oracle.forwardSshConnectivity.username
resource.oracle.host
resource.oracle.oracleAsmConfig.asmService
resource.oracle.oracleAsmConfig.hostname
resource.oracle.oracleAsmConfig.port
resource.oracle.oracleAsmConfig.ssl.sslFlags
resource.oracle.oracleAsmConfig.ssl.type
resource.oracle.oracleAsmConfig.username
resource.oracle.port
resource.oracle.privateConnectivity.privateConnection
resource.oracle.ssl.sslFlags
resource.oracle.ssl.type
resource.oracle.username
resource.postgresql.alloydbClusterId
resource.postgresql.cloudSqlId
resource.postgresql.database
resource.postgresql.host
resource.postgresql.port
resource.postgresql.privateServiceConnectConnectivity.serviceAttachment
resource.postgresql.ssl.sslFlags
resource.postgresql.ssl.type
resource.postgresql.username
resource.provider
resource.role
resource.sqlserver.backups.gcsBucket
resource.sqlserver.backups.gcsPrefix
resource.sqlserver.cloudSqlId
resource.sqlserver.cloudSqlProjectId
resource.sqlserver.database
resource.sqlserver.dbmPort
resource.sqlserver.forwardSshConnectivity.hostname
resource.sqlserver.forwardSshConnectivity.port
resource.sqlserver.forwardSshConnectivity.username
resource.sqlserver.host
resource.sqlserver.port
resource.sqlserver.privateConnectivity.privateConnection
resource.sqlserver.privateServiceConnectConnectivity.serviceAttachment
resource.sqlserver.ssl.sslFlags
resource.sqlserver.ssl.type
resource.sqlserver.username
resource.state
datamigration.googleapis.com/ConversionWorkspace resource.destination.engine
resource.destination.version
resource.destinationProvider
resource.displayName
resource.globalSettings
resource.name
resource.source.engine
resource.source.version
resource.sourceProvider
datamigration.googleapis.com/MigrationJob resource.cmekKeyName
resource.conversionWorkspace.commitId
resource.conversionWorkspace.name
resource.destination
resource.destinationDatabase.engine
resource.destinationDatabase.provider
resource.displayName
resource.dumpFlags.dumpFlags.name
resource.dumpFlags.dumpFlags.value
resource.dumpPath
resource.dumpType
resource.filter
resource.name
resource.objectsConfig.sourceObjectsConfig.objectConfigs.objectIdentifier.database
resource.objectsConfig.sourceObjectsConfig.objectConfigs.objectIdentifier.schema
resource.objectsConfig.sourceObjectsConfig.objectConfigs.objectIdentifier.table
resource.objectsConfig.sourceObjectsConfig.objectConfigs.objectIdentifier.type
resource.objectsConfig.sourceObjectsConfig.objectsSelectionType
resource.oracleToPostgresConfig.oracleSourceConfig.binaryLogParser.logFileDirectories.archivedLogDirectory
resource.oracleToPostgresConfig.oracleSourceConfig.binaryLogParser.logFileDirectories.onlineLogDirectory
resource.oracleToPostgresConfig.oracleSourceConfig.cdcStartPosition
resource.oracleToPostgresConfig.oracleSourceConfig.maxConcurrentCdcConnections
resource.oracleToPostgresConfig.oracleSourceConfig.maxConcurrentFullDumpConnections
resource.oracleToPostgresConfig.oracleSourceConfig.skipFullDump
resource.oracleToPostgresConfig.postgresDestinationConfig.maxConcurrentConnections
resource.oracleToPostgresConfig.postgresDestinationConfig.transactionTimeout
resource.performanceConfig.dumpParallelLevel
resource.reverseSshConnectivity.vm
resource.reverseSshConnectivity.vmIp
resource.reverseSshConnectivity.vmPort
resource.reverseSshConnectivity.vpc
resource.source
resource.sourceDatabase.engine
resource.sourceDatabase.provider
resource.sqlserverHomogeneousMigrationJobConfig.backupFilePattern
resource.sqlserverHomogeneousMigrationJobConfig.dagConfig.linkedServer
resource.sqlserverHomogeneousMigrationJobConfig.dagConfig.sourceAg
resource.sqlserverHomogeneousMigrationJobConfig.databaseBackups.database
resource.sqlserverHomogeneousMigrationJobConfig.databaseBackups.encryptionOptions.certPath
resource.sqlserverHomogeneousMigrationJobConfig.promoteWhenReady
resource.sqlserverHomogeneousMigrationJobConfig.useDiffBackup
resource.sqlserverToPostgresConfig.postgresDestinationConfig.maxConcurrentConnections
resource.sqlserverToPostgresConfig.postgresDestinationConfig.transactionTimeout
resource.sqlserverToPostgresConfig.sqlserverSourceConfig.cdcStartPosition
resource.sqlserverToPostgresConfig.sqlserverSourceConfig.maxConcurrentCdcConnections
resource.sqlserverToPostgresConfig.sqlserverSourceConfig.maxConcurrentFullDumpConnections
resource.sqlserverToPostgresConfig.sqlserverSourceConfig.skipFullDump
resource.state
resource.type
resource.vpcPeeringConnectivity.vpc
datamigration.googleapis.com/PrivateConnection resource.displayName
resource.name
resource.pscInterfaceConfig.networkAttachment
resource.vpcPeeringConfig.subnet
resource.vpcPeeringConfig.vpcName

What's next