Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,613 questions
1 answer
vm cpu utilization
Hi, have 100 VMs in Azure portal's resource group for which i am running VM memory metrix(cpu usage) .. how can it will automatically recognized the new subscription of vm came so that it will show the cpu usage via loading adf or databricks pipeline
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 13%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Connecting to databricks using .Net
Hello Team, Is it possible to connect to Databricks and perform CRUD operations on catalog schema tables and Delta tables using .NET? If so, what approach is needed to connect to Databricks using JDBC or ODBC? Are there any specific libraries in Visual…
.NET
.NET
Microsoft Technologies based on the .NET software framework.
3,565 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 53%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENC%3C/text%3E%3C/svg%3E)
1 answer
How to know which type of service we need within azure databricks for our implementation
I need to know the different types of services available within databricks to implement my solution more cost efficiently. Is there any resource from azure we can reach out to whom we can explain our implementation and they can provide the list of…
asked 2024-06-21T09:22:35.21+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 85%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Arun Kumar
0
Reputation points
edited a comment 2024-06-25T09:41:40.9366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,090
Reputation points Microsoft Vendor
1 answer
How can I migrate data bricks from one subscription to another subscription during cross subscription migration ?
I am unable to move data brick from the source subscription to the destination subscription during cross-subscription migration
asked 2024-06-19T19:20:06.0166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 66%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMA%3C/text%3E%3C/svg%3E)
Maaz Ahmed Nagori
0
Reputation points
commented 2024-06-25T08:26:08.2166667+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
1 answer
Downsizing subnets that are associated with a databricks workspace
Hi, Is it possible to downsize the private and public subnets that currently have nothing attached to it but are use by a databricks workspace? Would this require the databricks cluster to be redeployed? Are there any extra steps needed so the…
asked 2024-06-24T11:10:32.2233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 61%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
azmag
0
Reputation points
edited a comment 2024-06-25T07:29:21.0666667+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
0 answers
I am unable to move data brick from the source subscription to the destination subscription during cross-subscription migration
I am unable to move data brick from the source subscription to the destination subscription during cross-subscription migration
asked 2024-06-19T19:22:30.1166667+00:00
Maaz Ahmed Nagori
0
Reputation points
commented 2024-06-24T19:57:49.5933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
28,526
Reputation points Microsoft Employee
1 answer
DataBricks Unity Catalog Lineage
Hi, I'm looking for support on the Databricks Unity Catalog (on the data lineage). So I'm trying to establish lineage between 2 schemas (with 50 odd tables within each schema). Data for the first schema is fetched from source files (via ADF pipeline),…
asked 2024-06-20T06:15:49.5666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(307.2, 34%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
S, Santhosh M
0
Reputation points
answered 2024-06-24T08:33:46.89+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
2 answers
Databricks not sending audit logs to event hub
Hi, I'm trying to push all the logs from databricks using the diagnostic tool to event hub but is not working, it didn't push anything. I'm using the root access policy and also already created the eventhub name, what else I'm probably missing? Thanks in…
asked 2024-06-13T19:41:27.85+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 92%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDA%3C/text%3E%3C/svg%3E)
Danny AMAYA
0
Reputation points
commented 2024-06-24T07:31:44.73+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Pipeline Executing Databricks Notebook Successfully Despite Stopped Cluster
In Azure Data Factory (ADF), I have a pipeline that executes a notebook in Azure Databricks. I noticed that even when the Databricks cluster is stopped, the ADF pipeline still completes successfully, and the notebook runs without any issues. Is this…
asked 2024-06-20T11:17:32.34+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 15%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV0%3C/text%3E%3C/svg%3E)
vikranth-0706
180
Reputation points
accepted 2024-06-23T14:51:08.82+00:00
vikranth-0706
180
Reputation points
1 answer
One of the answers was accepted by the question author.
logic app to save data in adls gen2
Hi all, I would like to utilize logic app to write into adls gen2. After the file is saved in adls gen2, it should be able to read by databrick as delta table. May I know is there a specific file format to do it or how it can be achived? thanks
asked 2024-06-20T15:02:05.7333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 25%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYC%3C/text%3E%3C/svg%3E)
Yang Chow Mun
121
Reputation points
accepted 2024-06-22T06:58:10.9333333+00:00
Yang Chow Mun
121
Reputation points
2 answers
Managed storage account's compliance
Azure Databricks managed storage accounts need to have the key access disabled. But since these have deny assignment, I am able to see / influence the configuration. How do I make these storage accounts be green for this compliance?
asked 2024-06-19T17:48:49.89+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(160, 46%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECG%3C/text%3E%3C/svg%3E)
Chitra Gurumurthy (NON EA SC ALT)
0
Reputation points Microsoft Employee
answered 2024-06-20T10:50:03.1366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 64%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENR%3C/text%3E%3C/svg%3E)
Nehruji R
4,126
Reputation points Microsoft Vendor
1 answer
Restricting files/folders to upload into External volumes in Azure databricks UC workspace
Hello Team, Is there a way to restrict the files or folders to upload/download from external volumes same like DBFS? Is there any option to disable the uploading files/folders feature in external volumes of azure databricks workspace with Unity Catalog.…
asked 2024-06-06T17:37:57.5833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 24%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAG%3C/text%3E%3C/svg%3E)
Ashwini Gaikwad
110
Reputation points
answered 2024-06-19T17:44:17.9266667+00:00
BhargavaGunnam-MSFT
28,526
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
How to restore myspace and files created with Student subscription?
Hello, I had a Student Azure subscription in 2022-2023 and created some resources and lots of files in Databricks. then my subscription expired and I could not renew it though I am still a student. I created a paid subscription today in hope to see my…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 64%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
2 answers
One of the answers was accepted by the question author.
How to setup modern Arcitechure for Small/Medium Business?
Currently we're using the following setup which is slow to process the data and is slow on the power bi side: Azure VM for third parties to upload via sftp C# script to ETL data to azure sql server and move files to ADLS Gen2 Power BI report pulling…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 42%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
1 answer
How can I clear the cache in my Databricks Cluster
Ive tried many articles and links without success. Has anyone managed to successfully clear the cache on their Databricks cluster? This causes many issues as my memory is near its peak, meaning my notebooks often crashes. Any help or advised would be…
asked 2024-06-18T11:53:11.7766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 16%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERH%3C/text%3E%3C/svg%3E)
richardthomas66@hotmail.com
0
Reputation points
answered 2024-06-18T17:01:11.2466667+00:00
BhargavaGunnam-MSFT
28,526
Reputation points Microsoft Employee
1 answer
While running databricks migrate pipeline facing an issue with invalid configuration for storage account key
Hello Team, I am trying to run the yaml pipeline for azure databricks migration from Non UC workspace to UC workspace for reference this is the rep https://github.com/databrickslabs/migrate so while exporting the hive metastore, I am running into error…
asked 2024-06-17T15:46:25.1033333+00:00
Ashwini Gaikwad
110
Reputation points
answered 2024-06-18T14:55:54.1+00:00
BhargavaGunnam-MSFT
28,526
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
How to get the public IP range of my Azure Databricks cluster? I Need to whitelist this IP range with a host that I want to connect and get data from.
How to get the public IP range of my Azure Databricks cluster? I Need to whitelist this IP range with a host that I want to connect to and get data from.
asked 2024-06-13T08:19:20.98+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 67%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMN%3C/text%3E%3C/svg%3E)
Makarand Nidhalkar
20
Reputation points
accepted 2024-06-18T13:41:17.45+00:00
Makarand Nidhalkar
20
Reputation points
1 answer
One of the answers was accepted by the question author.
Databricks Simba Spark ODBC .NET8 C# Driver Parameters in SQL Queries
Hello, I'm using Simba ODBC driver v2.8.0 in order to query data from my azure databrick sql warehouse into a .net 8 Asp.net Api App. The ODBC driver works fine using plain text query but i need to parametrize the query. Searching around I found that it…
asked 2024-06-03T15:30:12.4666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 63%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELN%3C/text%3E%3C/svg%3E)
Luigi Navarra
25
Reputation points
accepted 2024-06-18T07:16:04.8966667+00:00
Luigi Navarra
25
Reputation points
1 answer
One of the answers was accepted by the question author.
ADF Linked Service connection to Databrciks SQL
Hi Team, I need to read table from the Azure Databricks SQL end point, can you please let me know how to setup the linked service. i know this option was not there around one year before, just checking if anything new came up. please do not suggest other…
asked 2024-06-13T15:53:58.6566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 8%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Sharukh Kundagol
125
Reputation points
accepted 2024-06-18T06:02:35.1566667+00:00
Sharukh Kundagol
125
Reputation points
1 answer
Admin portal option is not visible in my account
Admin portal option is not visible in my account. Could you please assist me.
asked 2024-06-12T19:08:22.1166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 3%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
Deepak2024
0
Reputation points
commented 2024-06-18T05:52:11.7066667+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee