Troubleshoot deleting clusters
Stay organized with collections
Save and categorize content based on your preferences.
This page shows you how to resolve issues with deleting ephemeral
Dataproc clusters in Cloud Data Fusion.
When Cloud Data Fusion creates an ephemeral Dataproc cluster
during pipeline run provisioning, the cluster gets deleted after the pipeline
run is finished. In rare cases, the cluster deletion fails.
Strongly recommended: Upgrade to the most recent Cloud Data Fusion
version to ensure proper cluster maintenance.
Skip cluster deletion
For debugging purposes, you can stop the automatic deletion of an ephemeral
cluster.
To stop the deletion, set the Skip Cluster Deletion property to True. You
must manually delete the cluster after you finish debugging.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2026-02-25 UTC."],[],[]]
