unable to deploy libraryRequirements in Azure Synapse sparkpool via bicep
Bicep version Bicep CLI version 0.10.61 (8f44805506)
Describe the bug Error: SparkComputePropertiesNotAllowed Synapse Spark pool must be created before libraries are installed
To Reproduce Try to create sparkpool resource with libraryRequirements section filled in. 'Microsoft.Synapse/workspaces/bigDataPools@2021-06-01'
libraryRequirements: {
content: content
filename: filename
}
Additional context Either put the libraryRequirements as separate resource to sparkpool (if it requires time), or build in mechanism to wait for sparkpool creation. If it is provided as part of resource it shall be created in one run.
Can you provide the full bicep file or resource (feel free to redact sensitive parts) for a repro?
Sure thing:
resource sparkpool 'Microsoft.Synapse/workspaces/bigDataPools@2021-06-01' = {
name: PoolName
location: location
parent: synapse
properties:{
autoPause:{
enabled: true
delayInMinutes: 15
}
nodeSize: nodeSize
nodeSizeFamily: 'MemoryOptimized'
autoScale:{
enabled: true
minNodeCount: MinNodeCount
maxNodeCount: MaxNodeCount
}
libraryRequirements: {
content: content
filename: filename
}
sparkVersion: '3.1'
}
}