Using Heterogeneous Nodes in Hadoop and Spark Clusters

For a heterogeneous cluster:

• The QDS UI displays supported instance types with weights based on instance memory. You can use the scrollable counter to change the weight as needed.
• The first instance type must be the same as the cluster’s worker instance type and have a weight of 1.0. This is the primary instance type. Make sure that the first instance type is the primary instance type if you are using Qubole’s APIs to create a heterogeneous cluster.
• QDS will try the rest of the instance types whenever it needs to provision nodes and when nodes from the earlier list are unavailable. The number of instances requested is decided by the weight.

Selecting different instance types using the QDS UI

See Configuring Heterogeneous Worker Nodes in the QDS UI for information about configuring heterogeneous nodes.