Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,045 questions
2 answers
File(filePath).exists does not work in Azure databricks
Hi, How to find if file exists in a path in the data lake? Regards Rajaniesh
asked 2020-06-11T20:12:45.693+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 49%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rajaniesh Kaushikk
476
Reputation points
answered 2020-06-14T04:01:39.583+00:00
Rajaniesh Kaushikk
476
Reputation points
2 answers
One of the answers was accepted by the question author.
Accessing dataframe created in Scala from Python command
Is there a way to create a Spark dataframe in Scala command, and then access it in Python, without explicitly writing it to disk and re-reading? In Databricks I can do in Scala dfFoo.createOrReplaceTempView("temp_df_foo") and it then in…
1 answer
One of the answers was accepted by the question author.
Standard Configuration Conponents of the Azure Datacricks
Hello, Could you please tell me standard configuration components of the Azure Databricks. What are the Azure components (storage?) required for the configuration of the Azure Databricks? Thank you. Sincerely, Kenjiro Majima
asked 2020-05-29T04:20:47.017+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 60%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
Kenjiro Majima
21
Reputation points
commented 2020-06-03T05:07:39.423+00:00
Kenjiro Majima
21
Reputation points
1 answer
One of the answers was accepted by the question author.
How to integrate/add more metrics & info into Ganglia UI in Databricks Jobs
As per https://video2.skills-academy.com/en-us/azure/databricks/clusters/clusters-manage#monitor-performance, Ganglia metrics Collection Period Snapshot modifications can be done using init scripts. Could you please help with pointers to modify by default…
asked 2020-05-08T08:37:57.927+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 57.99999999999999%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERH%3C/text%3E%3C/svg%3E)
Ramya Harinarthini_MSFT
5,316
Reputation points Microsoft Employee
accepted 2020-05-08T09:13:16.457+00:00
Ramya Harinarthini_MSFT
5,316
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Azure databricks is not available in free trial subscription
If i have understood it right, Azure databricks is not available on free tier account. I currently have a free tier, 12 month subscription. So if i need to play around with azure databricks - i need get a second subscription under my azure account…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 35%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)