Skip to main content

SparkWorkspaceSettings

Properties

PropertyTypeAttributesDescription
workspaceIdstringRequired, IdentifierThe containing Fabric workspace ID
automaticLogSparkAutomaticLogPropertiesAutomatic log properties
environmentSparkEnvironmentPropertiesEnvironment properties
highConcurrencySparkHighConcurrencyPropertiesHigh concurrency properties
jobSparkJobPropertiesJob properties
poolSparkPoolPropertiesPool properties

SparkAutomaticLogProperties

PropertyTypeAttributesDescription
enabledboolWhether automatic log is enabled

SparkEnvironmentProperties

PropertyTypeAttributesDescription
namestringThe name of the default environment
runtimeVersionstringThe default runtime version

SparkHighConcurrencyProperties

PropertyTypeAttributesDescription
notebookInteractiveRunEnabledboolWhether high concurrency for notebook interactive runs is enabled
notebookPipelineRunEnabledboolWhether high concurrency for notebook pipeline runs is enabled

SparkJobProperties

PropertyTypeAttributesDescription
conservativeJobAdmissionEnabledboolWhether the maximum number of cores needed for active Spark jobs is reserved
sessionTimeoutInMinutesintThe time, in minutes, to terminate inactive Spark sessions. The maximum is 20160 (14 days)

SparkPoolProperties

PropertyTypeAttributesDescription
customizeComputeEnabledboolWhether compute configurations can be customized for items
defaultPoolSparkInstancePoolThe default pool for the workspace
starterPoolSparkStarterPoolPropertiesThe starter pool configuration for the workspace

SparkInstancePool

PropertyTypeAttributesDescription
idstringThe pool ID. '00000000-0000-0000-0000-000000000000' means use the starter pool
namestringThe pool name. 'Starter Pool' means use the starter pool
type'Workspace' | 'Capacity'The pool type

SparkStarterPoolProperties

PropertyTypeAttributesDescription
maxExecutorsintThe maximum executor count
maxNodeCountintThe maximum node count