Databricks error: Failed to download bootstrap script from artifact storage

Porsche Me 136 Reputation points
2021-03-21T08:25:41.673+00:00

Azure Firewall: Hub & Spoke architecture
Databricks: 7.4 runtime
Azure region: West Us2

I followed this data-exfiltration-protection-with-azure-databricks.html detailed walkthrough guide to setup protect data exfiltration with Azure Firewall and Databricks in our dev environment. After the setup, I was never be able to start my Databricks cluster.

Any help to resolve this error is very much appreciated.

Logs on the cluster

Cluster terminated. Reason: Storage Download Failure  
  
Failed to download bootstrap script from artifact storage. Please check that instances have connectivity to cloud storage.  
Instance bootstrap failed command: DownloadBootstrapScript  
Failure message: (Base64 encoded) VM extension code: ProvisioningState/succeeded  
----REDACTED----  
instanceId: InstanceId(3cf2fd8a96e5407cb868d636fdee9d48)  
workerEnv: workerenv-979924835046728  
Additional details (may be truncated):  
  
	[Bootstrap Event] Command DownloadBootstrapScript finished. Storage Account: arprodwestus2a1.blob.core.windows.net [FAILED] [Will try other storage accounts]  
	[Bootstrap Event] Command DownloadBootstrapScript finished. Storage Account: arprodwestus2a3.blob.core.windows.net [FAILED] [Will try other storage accounts]  
	[Bootstrap Event] Command DownloadBootstrapScript finished. Storage Account: dbartifactsprodwestus2.blob.core.windows.net [FAILED] [Will try other storage accounts]  
	[Bootstrap Event] Command DownloadBootstrapScript finished. Storage Account: arprodwestusa14.blob.core.windows.net [FAILED] [Will try other storage accounts]  
	[Bootstrap Event] Command DownloadBootstrapScript finished. Storage Account: arprodwestusa11.blob.core.windows.net [FAILED] [Will try other storage accounts]  
	[Bootstrap Event] Command DownloadBootstrapScript finished. Storage Account: dbartifactsprodwestus.blob.core.windows.net [FAILED] [Will try other storage accounts]  
	[Bootstrap Event] {FAILED_COMMAND:DownloadBootstrapScript}  
	[Bootstrap Event] {FAILED_MESSAGE:(Base64 encoded) ----REDACTED----}  
	[Bootstrap Event] SELF BOOTSTRAP FAILED  
	[Bootstrap Event] Can reach arprodwestus2a1.blob.core.windows.net: [SUCCEEDED]  
	[Bootstrap Event] Can reach arprodwestus2a3.blob.core.windows.net: [SUCCEEDED]  
	[Bootstrap Event] Can reach dbartifactsprodwestus2.blob.core.windows.net: [SUCCEEDED]  
	[Bootstrap Event] Can reach arprodwestusa14.blob.core.windows.net: [SUCCEEDED]  
	[Bootstrap Event] Can reach arprodwestusa11.blob.core.windows.net: [SUCCEEDED]  
	[Bootstrap Event] Can reach dbartifactsprodwestus.blob.core.windows.net: [SUCCEEDED]  
	[Bootstrap Event] Can reach westus.azuredatabricks.net: [SUCCEEDED]  

Firewall Application Rule Collection

79819-application-databricks-control-plane-services.png

Firewall Network Rule Collection

79874-network-databricks-control-plane-services.png

Azure Firewall
Azure Firewall
An Azure network security service that is used to protect Azure Virtual Network resources.
681 questions
Azure Virtual Network
Azure Virtual Network
An Azure networking service that is used to provision private networks and optionally to connect to on-premises datacenters.
2,509 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,218 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Porsche Me 136 Reputation points
    2021-03-22T04:34:13.437+00:00

    This issue is resolved now.

    This linkudr was very useful in getting the job done.
    I mean data exfiltration protection with Azure Databricks and Azure Firewall Premium.

    That being said, working with the firewall was never an easy task.

    4 people found this answer helpful.

  2. Jay Mehta 1 Reputation point
    2022-11-07T21:11:36.963+00:00

    @Porsche Me how did you solve this issue. I'm facing the same error and not sure how to move forward

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.