I think the error you are getting often arises due to permission issues when setting up the access connector for Azure Databricks. Here are a few things to check to help troubleshoot:
You may need to verify that the user setting up the access connector has the necessary permissions on the resource group containing the Azure Databricks and storage resources. Specifically, they need Owner
or Contributor
permissions on both the resource group and the storage account.
The error may relate to missing roles for the managed identity linked to the access connector. Make sure the Databricks managed identity has the following roles assigned on the storage account:
- Storage Blob Data Contributor (for full access to storage containers)
- Storage Blob Data Reader (if only read access is needed)
Don't forget when creating the access connector, specify the correct subscription, resource group, and storage account. Confirm that the managed identity linked to the access connector is assigned properly, as this step is crucial to ensure that Azure Databricks can access the storage account.