SparkWorkspaceSettings
Properties
| Property | Type | Attributes | Description |
|---|---|---|---|
workspaceId | string | Required, Identifier | The containing Fabric workspace ID |
automaticLog | SparkAutomaticLogProperties | Automatic log properties | |
environment | SparkEnvironmentProperties | Environment properties | |
highConcurrency | SparkHighConcurrencyProperties | High concurrency properties | |
job | SparkJobProperties | Job properties | |
pool | SparkPoolProperties | Pool properties |
SparkAutomaticLogProperties
| Property | Type | Attributes | Description |
|---|---|---|---|
enabled | bool | Whether automatic log is enabled |
SparkEnvironmentProperties
| Property | Type | Attributes | Description |
|---|---|---|---|
name | string | The name of the default environment | |
runtimeVersion | string | The default runtime version |
SparkHighConcurrencyProperties
| Property | Type | Attributes | Description |
|---|---|---|---|
notebookInteractiveRunEnabled | bool | Whether high concurrency for notebook interactive runs is enabled | |
notebookPipelineRunEnabled | bool | Whether high concurrency for notebook pipeline runs is enabled |
SparkJobProperties
| Property | Type | Attributes | Description |
|---|---|---|---|
conservativeJobAdmissionEnabled | bool | Whether the maximum number of cores needed for active Spark jobs is reserved | |
sessionTimeoutInMinutes | int | The time, in minutes, to terminate inactive Spark sessions. The maximum is 20160 (14 days) |
SparkPoolProperties
| Property | Type | Attributes | Description |
|---|---|---|---|
customizeComputeEnabled | bool | Whether compute configurations can be customized for items | |
defaultPool | SparkInstancePool | The default pool for the workspace | |
starterPool | SparkStarterPoolProperties | The starter pool configuration for the workspace |
SparkInstancePool
| Property | Type | Attributes | Description |
|---|---|---|---|
id | string | The pool ID. '00000000-0000-0000-0000-000000000000' means use the starter pool | |
name | string | The pool name. 'Starter Pool' means use the starter pool | |
type | 'Workspace' | 'Capacity' | The pool type |
SparkStarterPoolProperties
| Property | Type | Attributes | Description |
|---|---|---|---|
maxExecutors | int | The maximum executor count | |
maxNodeCount | int | The maximum node count |