Cluster

Properties

Property	Type	Attributes	Description
clusterName	string	Required, Identifier	The name of the cluster.
nodeTypeId	string	Required	The node type ID for worker nodes.
sparkVersion	string	Required	The Spark version of the cluster.
autoScale	AutoScale		Auto-scaling configuration for the cluster.
autoterminationMinutes	int		Auto-termination time in minutes.
azureAttributes	AzureAttributes		Azure-specific attributes for the cluster.
clusterCores	int	Read-only	The number of cores in the cluster.
clusterMemoryMb	int	Read-only	The memory in MB of the cluster.
creatorUserName	string	Read-only	The creator username of the cluster.
dataSecurityMode	string		Data security mode for the cluster.
driverNodeTypeId	string		The node type ID for the driver node.
jdbcPort	int	Read-only	The JDBC port of the cluster.
numWorkers	int		The number of worker nodes.
runtimeEngine	string		Runtime engine for the cluster.
singleUserName	string		Single user name for single-user clusters.
startTime	int	Read-only	The start time of the cluster.
state	string	Read-only	The current state of the cluster.
stateMessage	string	Read-only	The state message of the cluster.

AutoScale

Property	Type	Attributes	Description
maxWorkers	int	Required	Maximum number of worker nodes.
minWorkers	int	Required	Minimum number of worker nodes.

AzureAttributes

Property	Type	Attributes	Description
availability	string		Availability type for Azure instances.
firstOnDemand	int		Number of on-demand instances to use before using spot instances.
spotBidMaxPrice	int		Maximum price for spot instances.