bicep icon indicating copy to clipboard operation
bicep copied to clipboard

unable to deploy libraryRequirements in Azure Synapse sparkpool via bicep

Open Vox1984 opened this issue 3 years ago • 2 comments

Bicep version Bicep CLI version 0.10.61 (8f44805506)

Describe the bug Error: SparkComputePropertiesNotAllowed Synapse Spark pool must be created before libraries are installed

To Reproduce Try to create sparkpool resource with libraryRequirements section filled in. 'Microsoft.Synapse/workspaces/bigDataPools@2021-06-01'

    libraryRequirements:  {
      content: content
      filename: filename
    }

Additional context Either put the libraryRequirements as separate resource to sparkpool (if it requires time), or build in mechanism to wait for sparkpool creation. If it is provided as part of resource it shall be created in one run.

Vox1984 avatar Sep 28 '22 08:09 Vox1984

Can you provide the full bicep file or resource (feel free to redact sensitive parts) for a repro?

stephaniezyen avatar Sep 28 '22 19:09 stephaniezyen

Sure thing:

resource sparkpool 'Microsoft.Synapse/workspaces/bigDataPools@2021-06-01' =  {
    name: PoolName
    location: location
    parent: synapse
    properties:{
      autoPause:{
        enabled: true
        delayInMinutes: 15
      }
      nodeSize: nodeSize
      nodeSizeFamily: 'MemoryOptimized'
      autoScale:{
        enabled: true
        minNodeCount: MinNodeCount
        maxNodeCount: MaxNodeCount
      }
      libraryRequirements:  {
        content: content
        filename: filename
      }
      sparkVersion: '3.1'
    }
  }

Vox1984 avatar Sep 29 '22 15:09 Vox1984