Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
2 answers
How to use managed identity in ADF or synapse linked service
Hi , I need some clarity on how managed identity works in linked service. As per my understanding, We create a app registration for synapse or ADF. We get the ID of app registration. Go to the resource we want to access from Synapse or ADF.…
asked 2024-06-21T06:58:15.7266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 0%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
Ranjana
0
Reputation points
edited the question 2024-06-24T09:24:43.32+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 39%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
SwathiDhanwada-MSFT
18,461
Reputation points
2 answers
This request is not authorized to perform this operation using this permission.", 403, HEAD Synapse connect to adls
I am trying to select data from ADLS Gen2 storage delta table and keep receiving this error. I added the synapse service principal as storage blob data contributor and ACLs to container with no luck. Firewall is set to enable all networks as well. Please…
asked 2024-06-22T20:29:54.0233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 87%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDW%3C/text%3E%3C/svg%3E)
Daniel Woodhouse
0
Reputation points
answered 2024-06-24T09:10:11.0333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 64%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENR%3C/text%3E%3C/svg%3E)
Nehruji R
4,126
Reputation points Microsoft Vendor
1 answer
Static Code Analysis for ADF or Synapse Pipelines in Azure
Hi team, I would like to know is there any use case possible to perform static code analysis of our ADF or Synapse pipelines residing in Azure DevOps repository? Thanks, Debajit Mitra
asked 2024-06-14T03:42:29.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 48%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDM%3C/text%3E%3C/svg%3E)
Debajit Mitra
0
Reputation points
commented 2024-06-24T05:36:30.8133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,090
Reputation points Microsoft Vendor
1 answer
Dedicated SQL pool storage capacity and database details
Hello, As per our client they have provisioned Dedicated SQL pool for 5 Years with 5 TB storage capacity, and I need to find how much storage been occupied and how much storage is left. anyone can assist me on this please?
asked 2023-12-05T04:48:05.76+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 75%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Amit Kamble
40
Reputation points
edited a comment 2024-06-23T08:40:08.6766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 20%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMF%3C/text%3E%3C/svg%3E)
Massimiliano Figini
0
Reputation points
2 answers
One of the answers was accepted by the question author.
Issue with DACPAC deployment of SQL Dedicated Pool
Hello, I am trying to implement automatically deployment of SQL Dedicated Pool from one environment to the other using DACPAC. I am using visual studio code as my IDE. i was able to connect to the database and was able to build the .sqlproj file. However…
asked 2024-06-17T21:05:37.8733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 15%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Admin (KK)
131
Reputation points
accepted 2024-06-21T16:45:50.05+00:00
Admin (KK)
131
Reputation points
1 answer
Failed to create Livy session for executing notebook
Dear Team, We are facing an issue with Azure Synapse Spark pool. "errorCode": "6002", "message": "Exception: Failed to create Livy session for executing notebook. CLUSTER_CREATION_TIMED_OUT: Livy session has…
asked 2024-06-20T12:03:33.6666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(41.6, 1%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
Shenbahagomathi Gnanasambandan
10
Reputation points
answered 2024-06-21T15:30:45.66+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
28,526
Reputation points Microsoft Employee
2 answers
Azure Synapse Analytics Pipeline Deployment Error Spark Configuration
Hello I have a YAML pipeline in Azure Dev Ops to deploy my Synapse Workspace from development to UAT. As soon as I add in a spark configuration the deployment fails with the following error... [error]Encountered with exception:Error: For Artifact…
asked 2022-07-05T11:18:23.22+00:00
Graeme Cash
71
Reputation points
commented 2024-06-21T10:19:53.16+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 0%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETM%3C/text%3E%3C/svg%3E)
Tony McNicholas
0
Reputation points
0 answers
Unable to list the directory when create view for delta
Assuming, I have the a single spark dataframe outputted as DELTA into two folders using pyspark: folder A and folder B in the same blob storage Gen2 For Folder A and Folder B, both have external data source created with same credentials using sql…
asked 2024-06-18T10:04:42.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 28.999999999999996%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYC%3C/text%3E%3C/svg%3E)
Yap Chun Hing
5
Reputation points
commented 2024-06-19T19:38:43.4266667+00:00
BhargavaGunnam-MSFT
28,526
Reputation points Microsoft Employee
1 answer
read data from azure sql using a pyspark notebook
Hi, I am trying to read data from an "azure sql" , using a pyspark notebook and it seems that there is something missing. I enclose below. How could I add this data source ? Read data from SQL server table Py4JJavaError …
asked 2024-06-18T09:50:50.85+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 18%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJZ%3C/text%3E%3C/svg%3E)
Jon Z
40
Reputation points
commented 2024-06-19T16:46:24.95+00:00
BhargavaGunnam-MSFT
28,526
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
spark pool, notebook, using magic sql
Hello I am trying to query from a table, in my dedicated pool, however, it seems that is not finding the table in the schema Table or view not found: "schema"."table"; line 1 pos 14; 'Project [*] +- 'UnresolvedRelation…
asked 2024-06-19T08:36:18.5866667+00:00
Jon Z
40
Reputation points
edited an answer 2024-06-19T13:07:31.54+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Unable to deploy code to another subscription
Hello I need help with smth and this is the current setup: Have many synapse Pipelines on subscription A I have created another subscription and workspace on another client tenant/subscription B. I created linked service and Integration Runtime on…
asked 2024-06-10T16:43:57.5733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 88%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EXM%3C/text%3E%3C/svg%3E)
Xhevahir Mehalla
160
Reputation points
accepted 2024-06-19T09:49:31.6333333+00:00
Xhevahir Mehalla
160
Reputation points
1 answer
One of the answers was accepted by the question author.
Is it possible to run an SSIS package with FUZZYGROUPING transformation in Azure?
I am using Fuzzy grouping transformation in SSIS locally "on premises", but I would like to explore the option to run it in Azure…
asked 2024-06-13T09:35:48.62+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 27%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJM%3C/text%3E%3C/svg%3E)
Jose M Naranjo-Espinosa
20
Reputation points
commented 2024-06-19T08:42:55.0333333+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
1 answer
Using Azure Synapse Analytics - can I use External Tables created using SQL Serveless pool in my Pipelines or data flows?
Hello - I have chosen Azure Synapse analytics tool as the ETL tool. Here's the scenario: Copy data from oracle OCI to Azure Data lake storage Want to use SQL serverless pool to extract data from Data lake Storage and transform it and store into…
asked 2024-06-04T13:15:37.9933333+00:00
Xhevahir Mehalla
160
Reputation points
edited a comment 2024-06-19T08:33:05.55+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
calling another notebook with mssparkutils.notebook.run - Kernel doesn't exist
i am not able to execute a notebook with mssparkutils.notebook.run. However the magic command %run 'notebook' works. i am getting an error like this: com.microsoft.spark.notebook.msutils.NotebookExecutionException: Fetch notebook content for…
asked 2023-03-15T07:46:42.0666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 69%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGF%3C/text%3E%3C/svg%3E)
Garon Fabienne
20
Reputation points
commented 2024-06-19T08:10:10.7366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 54%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHG%3C/text%3E%3C/svg%3E)
Hari Gouthami Narravula
0
Reputation points Microsoft Employee
2 answers
How to Directly Connect Azure synapse workspace to MongoDB atlas (running on private network) without using SHIR ?
Hello, Azure synapse Analytics configuration: Public network access to workspace endpoints : Enabled Allow Azure services and resources to access this workspace: Enabled IP: Allowed all Allow Azure Synapse Link for Azure SQL Database to bypass…
asked 2024-05-17T06:11:44.86+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 39%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
BM
46
Reputation points
answered 2024-06-19T06:38:25.01+00:00
ShaikMaheer-MSFT
38,321
Reputation points Microsoft Employee
1 answer
Dynamic Content Option for Password Field in SFTP Connector in Azure Synapse Analytics
I am working on a feature in Azure Synapse Analytics that connects to different SFTP servers dynamically based on a meta-data table. As I proceeded through it, I found out that in SFTP Linked Service, the PASSWORD field does not allow dynamic content.…
asked 2024-06-12T17:19:45.9533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 5%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
Khushank Madaan
0
Reputation points
edited a comment 2024-06-19T06:22:37.9+00:00
Smaran Thoomu
12,090
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
Exit multiple values from Azure Synapse analytics notebook
Hello, I want to Azure Synapse notebook to exit multiple values, and these values must be used as deciding factor to execute the Synapse ADF pipeline. For example, I have a dataframe with 10 columns in Synapse notebook, How do I pass entire dataframe…
asked 2023-08-02T04:21:42.4333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 82%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
DeGuy
40
Reputation points
answered 2024-06-19T01:13:31.87+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 91%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJT%3C/text%3E%3C/svg%3E)
Johan Tokarskij
0
Reputation points
0 answers
Why has Synapse Analytics pipeline reverted to a previous version of a notebook?
I made some changes to a couple of Synapse Analytics notebooks on Friday. These notebooks are part of an existing pipeline. I committed the changes, PRd and merged the branch as normal etc. The pipeline runs daily. It ran perfectly fine on Saturday,…
asked 2024-06-17T11:14:17.5533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 96%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDQ%3C/text%3E%3C/svg%3E)
Daniella Quinn
0
Reputation points
commented 2024-06-18T09:04:57.4233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 48%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Harishga
5,510
Reputation points Microsoft Vendor
1 answer
Error in Mapping Dataflow - 403, PUT, AuthorizationPermissionMismatch - request is not authorized
I've built a dataflow to perform a simple task - read from raw zone > drop duplicates > write to refined zone. Even though the permissions have been set correctly RWX for the Synapse MI (ACLs), I am encountering the following error -…
1 answer
One of the answers was accepted by the question author.
Azure Synapse Analytics Developer Endpoint Certificate Issue
I'm encountering an SSL connection issue while trying to call the Azure Synapse Analytics REST API using HttpClient in my ASP.NET Core API deployed on a Web App. The error message 'The SSL connection could not be established, see inner exception. The…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 32%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAL%3C/text%3E%3C/svg%3E)