Stay organized with collections
Save and categorize content based on your preferences.
This feature lets you select a
minimum CPU platform
for your Dataproc clusters. For example, when you create a cluster,
you can select Intel Skylake CPUs for the cluster's master
and/or worker instances to improve job performance.
Before using this feature, see Available regions & zones, which lists
the platforms available in each zone. You can also run the
gcloud compute zones describe zone command to list
the availableCpuPlatforms in your cluster's zone. For more information, see
Specifying a minimum CPU platform for VM instances.
Use minimum CPU platform
gcloud command
To specify a minimum CPU platform for your cluster's master and/or worker (including
preemptible) nodes, pass one or both of the following flags to the
gcloud dataproc clusters create
command:
To specify a minimum CPU platform for your cluster's master, primary worker,
and/or secondary (preemptible) worker nodes, set the minCpuPlatform field in
InstanceGroupConfig
for your master, primary worker, and/or secondary (preemptible) instances in your
cluster.create
request.
Console
You can specify a minimum CPU platform for your cluster's master and worker
nodes using the CPU PLATFORM AND GPU→CPU platform sections of the
Configure nodes panel on the Create a cluster
page in the Google Cloud console.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-04-29 UTC."],[[["This feature lets you choose a minimum CPU platform for Cloud Dataproc clusters, like Intel Skylake, to enhance job performance."],["You can find the available CPU platforms for each zone by checking the \"Available regions & zones\" or by using the `gcloud compute zones describe` command."],["The `gcloud dataproc clusters create` command allows you to specify minimum CPU platforms for master and worker nodes using the `--master-min-cpu-platform` and `--worker-min-cpu-platform` flags."],["Using the REST API, you can set the `minCpuPlatform` field in the `InstanceGroupConfig` to define the minimum CPU platform for master, primary, and secondary worker nodes."],["The Google Cloud console, specifically the \"Create a cluster\" page under the \"CPU PLATFORM AND GPU\" section, offers a way to select a minimum CPU platform for both master and worker nodes."]]],[]]
