Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,631 questions
1 answer
Error in Mapping Dataflow - 403, PUT, AuthorizationPermissionMismatch - request is not authorized
I've built a dataflow to perform a simple task - read from raw zone > drop duplicates > write to refined zone. Even though the permissions have been set correctly RWX for the Synapse MI (ACLs), I am encountering the following error -…
1 answer
One of the answers was accepted by the question author.
Azure Synapse Analytics Developer Endpoint Certificate Issue
I'm encountering an SSL connection issue while trying to call the Azure Synapse Analytics REST API using HttpClient in my ASP.NET Core API deployed on a Web App. The error message 'The SSL connection could not be established, see inner exception. The…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 32%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAL%3C/text%3E%3C/svg%3E)
1 answer
How can I implement access control on azure synapse analytics objects(pipeline, notebooks etc)?
Scenario: I have pipelines and Notebooks stored in Azure Synapse Analytics workspace. Now I want to give access to the Synapse workspace to different departments but only to the dedicated pipelines and codes. As I can only implement access control over…
asked 2024-06-17T08:03:03.7266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 79%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAT%3C/text%3E%3C/svg%3E)
Apurva Tiwari
40
Reputation points
commented 2024-06-18T06:10:04.5766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,105
Reputation points Microsoft Vendor
1 answer
DP203- Explore Synapse Lab 01 -Use a serverless SQL pool to analyze data
I encountered problem in running the SQL -- This is auto-generated code SELECT TOP 100 * FROM OPENROWSET( BULK 'https://datalakexxxxxxx.dfs.core.windows.net/files/product_data/products.csv', FORMAT = 'CSV', …
asked 2024-06-13T14:59:43.6+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 31%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Samantha Sow
0
Reputation points
commented 2024-06-18T06:00:14.69+00:00
PRADEEPCHEEKATLA-MSFT
84,531
Reputation points Microsoft Employee
2 answers
Error: External table 'RetailDB.dbo.Customer' is not accessible because content of directory cannot be listed.
Hi, I'm a learning path to receive Azure Data Engineer Associate cert. One of the modules asks that you download the customers.csv from github. I've since downloaded but receiving the following error after creating lake db and associated folders:…
asked 2024-06-14T19:14:00.3033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 40%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDB%3C/text%3E%3C/svg%3E)
Darrick B
0
Reputation points
commented 2024-06-18T05:01:41.26+00:00
Smaran Thoomu
12,105
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Synapse workspace deployment node-js error ERR_INVALID_ARG_TYPE
Hi I am working on a CI/CD DevOps pipeline for Synapse Analytics. The Synapse workspace is integrated in my git repo, and I want to use task 'Synapse Workspace Deployment' with operation 'validate' to generate the ARM templates. The task is configured as…
asked 2023-11-27T12:05:22.12+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 54%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Simon Plancke
25
Reputation points
edited a comment 2024-06-18T01:03:29.07+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(41.6, 1%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Abhinav Sundar Sajan Darsi
0
Reputation points
1 answer
ORA-12650: No common encryption or data integrity algorithm - connectivity error in Synapse.
Hi Team, We are using an Azure Self Hosted Integration Runtime to connect to an on-premise Oracle SQL Database, we had pipeline running everyday till yesterday before the west europe outage ( Ticket ID - RN9S-39Z ). Post the outage fix we have been…
asked 2024-06-12T09:18:51.3+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 84%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJA%3C/text%3E%3C/svg%3E)
Jayachandran, Athul
21
Reputation points
commented 2024-06-17T21:09:05.5966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
28,766
Reputation points Microsoft Employee
0 answers
Avoiding metric inflation during data processing in Dedicated SQL Pool (formerly SQL DW)
Hi all , Here is the scenario for which I am seeking suggestions: Whenever our data jobs run to refresh dimensions and facts, and a Tableau extract refresh occurs simultaneously, the extracts report inflated metrics. When we validate, the metrics on the…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 74%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Azure Synapse fails to load Lake Databases (500 error)
When loading a Synapse workspace, it sits at "loading resources" for awhile and eventually errors with a 500 for lake databases. The error is not particularly helpful. Any ideas on how I could potentially determine if it's a single data lake…
asked 2024-06-11T20:11:33.8566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 74%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETD%3C/text%3E%3C/svg%3E)
Timothy Dufrane
45
Reputation points
accepted 2024-06-17T13:58:15.3433333+00:00
Timothy Dufrane
45
Reputation points
1 answer
One of the answers was accepted by the question author.
Accessing Azure Synapse Dedicated SQL Pool Using PySpark Without Exposing Passwords
I want to create a notebook for processing data in a table from the database using PySpark, to be used later in a Databricks pipeline. I'm unsure how to read data from the existing database in the notebook without including my password. Here is my…
asked 2024-06-14T08:38:35.8933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 38%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVC%3C/text%3E%3C/svg%3E)
Vandrangi Charaz Kumar
40
Reputation points
accepted 2024-06-17T12:51:17.3066667+00:00
Vandrangi Charaz Kumar
40
Reputation points
1 answer
Updating Oracle on-premise table from a Synapse table
Hi, I need to update an Oracle on-premise table from a Synapse table by joining the Oracle table with the Synapse table avoiding to build a staging table on Oracle platform to copy the Synapse data. It is a problem to obtain the authorization from my…
asked 2024-06-01T12:00:58.09+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 41%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
pmscorca
877
Reputation points
commented 2024-06-17T12:49:14.95+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 5%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
ANIS ABIRIGA
0
Reputation points
2 answers
One of the answers was accepted by the question author.
Not able to fetch serverless sql db into azure synpase pipeline for copy data pool
Hello Community, I have created one serverless pool db in Synapse and am trying to connect this serverless sql db as a destination to get table from azure sql db. In the drop down , I am just getting my dedicated sql pool (dspcodemsynps) not…
asked 2024-06-13T13:08:30.7333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 24%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Ashish Asthana
40
Reputation points
answered 2024-06-17T12:43:14.7766667+00:00
Ashish Asthana
40
Reputation points
1 answer
One of the answers was accepted by the question author.
Querying table index stats not working
I am trying to query my tables index fragmentation in Azure Synapse studio with query: SELECT IPS.Index_type_desc, IPS.avg_fragmentation_in_percent, IPS.avg_fragment_size_in_pages, IPS.avg_page_space_used_in_percent, …
asked 2024-06-14T09:17:01.14+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 7.000000000000001%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJH%3C/text%3E%3C/svg%3E)
Jani Hämäläinen
40
Reputation points
accepted 2024-06-17T10:19:38.69+00:00
Jani Hämäläinen
40
Reputation points
0 answers
Connect and query to Azure database for PostgresSql from Synapse Analytics
Hi, Is there a way to connect and query Azure Database for PostgresSql from Synapse Analytics.We need near real time data from postgres database to join the CosmosDB data in Synapse Analytics. I would really appreciate for the input. Thanks!
asked 2024-06-13T12:33:24.1+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 34%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Sathya Sai Cheetirala
0
Reputation points
commented 2024-06-17T04:44:29.6133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 48%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Harishga
5,590
Reputation points Microsoft Vendor
1 answer
How to flatten an Array json using Azure Data Flow
I am tying to convert the following json to parquet file in azure synapse analytics, to get data from rows[]. The json response has : dimensionsheaders , metricheaders and rows, Where the dimensionsheaders and metricheaders hold the field names and…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(307.2, 89%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
2 answers
One of the answers was accepted by the question author.
Self-hosted machine unable to access Data Lake Storage account when running a pipeline using Synapse
Hello - I need your help again: Here's the story: I have azure synapse workspace I have created managed private end point created for ADLS - working fine I have create private endpoint created for ADLS - working fine ADLS have set the public access…
asked 2024-06-07T08:58:57.6633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 88%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EXM%3C/text%3E%3C/svg%3E)
Xhevahir Mehalla
140
Reputation points
edited the question 2024-06-14T07:57:57.3666667+00:00
PRADEEPCHEEKATLA-MSFT
84,531
Reputation points Microsoft Employee
7 answers
Error trying to validate storage account name while creating a new synapse workspace
I am unable to create a new data lake storage (gen2) account name in the basic tab for create Azure Synapse Workspace. The error I get is - " There was an error trying to validate storage account name. please try again ". The error message is…
asked 2022-08-03T07:01:54.587+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 2%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
Jozure
491
Reputation points
commented 2024-06-14T07:53:15.7966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 86%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJK%3C/text%3E%3C/svg%3E)
Joy Kimaiyo
0
Reputation points
2 answers
Notebook fails in pipeline due to error 6002 , user error
**Notebooks function well when run normally, however they malfunction when utilized in a pipeline. The cause of the error is data write in csv, however the reason for the failure is unknown. ** Operation on target Notebook 3 failed:…
asked 2024-06-11T08:08:46.39+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 80%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENM%3C/text%3E%3C/svg%3E)
NANDARAJ M
0
Reputation points
edited an answer 2024-06-14T06:17:23.1+00:00
Harishga
5,590
Reputation points Microsoft Vendor
1 answer
status of Built-in serverless sql pool is showing is Unreachable in the azure synapse workspace monitor
status of Built-in serverless sql pool is showing is Unreachable in the azure synapse workspace monitor
asked 2023-02-25T02:34:27.44+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 4%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBS%3C/text%3E%3C/svg%3E)
biplab sahoo
5
Reputation points
answered 2024-06-14T05:59:04.8266667+00:00
PRADEEPCHEEKATLA-MSFT
84,531
Reputation points Microsoft Employee
1 answer
How would I create a role to be Synapse Admin but block particular pipeline and linked services
We a introducing a new source of data into Synapse which is highly sensitive. However currently my team have admin on Synapse and dedicated SQL pool. How can I allow them to keep some of the admin access but not allow them to see the pipelines and linked…
asked 2024-06-06T10:59:15.0466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 96%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
JayZee64
0
Reputation points
commented 2024-06-14T05:28:16.48+00:00
Smaran Thoomu
12,105
Reputation points Microsoft Vendor