SparkEnvironmentSettings

Properties

Property	Type	Attributes	Description
environmentId	string	Required, Identifier	The Environment ID
publicationStatus	'Published' | 'Staging'	Required, Identifier	The publication status
workspaceId	string	Required, Identifier	The Workspace ID
driverCores	int		Spark driver cores. Must be one of: 4, 8, 16, 32, 64
driverMemory	string		Spark driver memory. Must be one of: 28g, 56g, 112g, 224g, 400g
dynamicExecutorAllocation	SparkEnvironmentDynamicExecutorAllocation		Dynamic Executor Allocation properties
executorCores	int		Spark executor cores. Must be one of: 4, 8, 16, 32, 64
executorMemory	string		Spark executor memory. Must be one of: 28g, 56g, 112g, 224g, 400g
pool	SparkEnvironmentPool		The environment pool
runtimeVersion	string		The runtime version
sparkProperties	Dictionary<string, String>		A map of key/value pairs of Spark properties. Keys must start with 'spark.' and contain no white spaces

SparkEnvironmentDynamicExecutorAllocation

Property	Type	Attributes	Description
enabled	bool		The status of the dynamic executor allocation
maxExecutors	int		The maximum executors. Must be set together with minExecutors
minExecutors	int		The minimum executors. Must be set together with maxExecutors

SparkEnvironmentPool

Property	Type	Attributes	Description
id	string	Read-only	The pool ID
name	string		The pool name. 'Starter Pool' means use the starting pool. Must be set together with type
type	'Capacity' | 'Workspace'		The pool type. Must be set together with name

Dictionary<string, String>

Additional properties of type string are allowed.