Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
1 answer
One of the answers was accepted by the question author.
Unable to deploy code to another subscription
Hello I need help with smth and this is the current setup: Have many synapse Pipelines on subscription A I have created another subscription and workspace on another client tenant/subscription B. I created linked service and Integration Runtime on…
asked 2024-06-10T16:43:57.5733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 88%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EXM%3C/text%3E%3C/svg%3E)
Xhevahir Mehalla
160
Reputation points
accepted 2024-06-19T09:49:31.6333333+00:00
Xhevahir Mehalla
160
Reputation points
1 answer
One of the answers was accepted by the question author.
Is it possible to run an SSIS package with FUZZYGROUPING transformation in Azure?
I am using Fuzzy grouping transformation in SSIS locally "on premises", but I would like to explore the option to run it in Azure…
asked 2024-06-13T09:35:48.62+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 27%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJM%3C/text%3E%3C/svg%3E)
Jose M Naranjo-Espinosa
20
Reputation points
commented 2024-06-19T08:42:55.0333333+00:00
PRADEEPCHEEKATLA-MSFT
84,381
Reputation points Microsoft Employee
1 answer
Using Azure Synapse Analytics - can I use External Tables created using SQL Serveless pool in my Pipelines or data flows?
Hello - I have chosen Azure Synapse analytics tool as the ETL tool. Here's the scenario: Copy data from oracle OCI to Azure Data lake storage Want to use SQL serverless pool to extract data from Data lake Storage and transform it and store into…
asked 2024-06-04T13:15:37.9933333+00:00
Xhevahir Mehalla
160
Reputation points
edited a comment 2024-06-19T08:33:05.55+00:00
PRADEEPCHEEKATLA-MSFT
84,381
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
calling another notebook with mssparkutils.notebook.run - Kernel doesn't exist
i am not able to execute a notebook with mssparkutils.notebook.run. However the magic command %run 'notebook' works. i am getting an error like this: com.microsoft.spark.notebook.msutils.NotebookExecutionException: Fetch notebook content for…
asked 2023-03-15T07:46:42.0666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 69%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGF%3C/text%3E%3C/svg%3E)
Garon Fabienne
20
Reputation points
commented 2024-06-19T08:10:10.7366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 54%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHG%3C/text%3E%3C/svg%3E)
Hari Gouthami Narravula
0
Reputation points Microsoft Employee
2 answers
How to Directly Connect Azure synapse workspace to MongoDB atlas (running on private network) without using SHIR ?
Hello, Azure synapse Analytics configuration: Public network access to workspace endpoints : Enabled Allow Azure services and resources to access this workspace: Enabled IP: Allowed all Allow Azure Synapse Link for Azure SQL Database to bypass…
asked 2024-05-17T06:11:44.86+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 39%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
BM
46
Reputation points
answered 2024-06-19T06:38:25.01+00:00
ShaikMaheer-MSFT
38,321
Reputation points Microsoft Employee
1 answer
Dynamic Content Option for Password Field in SFTP Connector in Azure Synapse Analytics
I am working on a feature in Azure Synapse Analytics that connects to different SFTP servers dynamically based on a meta-data table. As I proceeded through it, I found out that in SFTP Linked Service, the PASSWORD field does not allow dynamic content.…
asked 2024-06-12T17:19:45.9533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 5%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
Khushank Madaan
0
Reputation points
edited a comment 2024-06-19T06:22:37.9+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,100
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
Exit multiple values from Azure Synapse analytics notebook
Hello, I want to Azure Synapse notebook to exit multiple values, and these values must be used as deciding factor to execute the Synapse ADF pipeline. For example, I have a dataframe with 10 columns in Synapse notebook, How do I pass entire dataframe…
asked 2023-08-02T04:21:42.4333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 82%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
DeGuy
40
Reputation points
answered 2024-06-19T01:13:31.87+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 91%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJT%3C/text%3E%3C/svg%3E)
Johan Tokarskij
0
Reputation points
0 answers
Why has Synapse Analytics pipeline reverted to a previous version of a notebook?
I made some changes to a couple of Synapse Analytics notebooks on Friday. These notebooks are part of an existing pipeline. I committed the changes, PRd and merged the branch as normal etc. The pipeline runs daily. It ran perfectly fine on Saturday,…
asked 2024-06-17T11:14:17.5533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 96%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDQ%3C/text%3E%3C/svg%3E)
Daniella Quinn
0
Reputation points
commented 2024-06-18T09:04:57.4233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 48%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Harishga
5,590
Reputation points Microsoft Vendor
1 answer
Error in Mapping Dataflow - 403, PUT, AuthorizationPermissionMismatch - request is not authorized
I've built a dataflow to perform a simple task - read from raw zone > drop duplicates > write to refined zone. Even though the permissions have been set correctly RWX for the Synapse MI (ACLs), I am encountering the following error -…
1 answer
One of the answers was accepted by the question author.
Azure Synapse Analytics Developer Endpoint Certificate Issue
I'm encountering an SSL connection issue while trying to call the Azure Synapse Analytics REST API using HttpClient in my ASP.NET Core API deployed on a Web App. The error message 'The SSL connection could not be established, see inner exception. The…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 32%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAL%3C/text%3E%3C/svg%3E)
1 answer
How can I implement access control on azure synapse analytics objects(pipeline, notebooks etc)?
Scenario: I have pipelines and Notebooks stored in Azure Synapse Analytics workspace. Now I want to give access to the Synapse workspace to different departments but only to the dedicated pipelines and codes. As I can only implement access control over…
asked 2024-06-17T08:03:03.7266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 79%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAT%3C/text%3E%3C/svg%3E)
Apurva Tiwari
40
Reputation points
commented 2024-06-18T06:10:04.5766667+00:00
Smaran Thoomu
12,100
Reputation points Microsoft Vendor
1 answer
DP203- Explore Synapse Lab 01 -Use a serverless SQL pool to analyze data
I encountered problem in running the SQL -- This is auto-generated code SELECT TOP 100 * FROM OPENROWSET( BULK 'https://datalakexxxxxxx.dfs.core.windows.net/files/product_data/products.csv', FORMAT = 'CSV', …
asked 2024-06-13T14:59:43.6+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 31%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Samantha Sow
0
Reputation points
commented 2024-06-18T06:00:14.69+00:00
PRADEEPCHEEKATLA-MSFT
84,381
Reputation points Microsoft Employee
2 answers
Error: External table 'RetailDB.dbo.Customer' is not accessible because content of directory cannot be listed.
Hi, I'm a learning path to receive Azure Data Engineer Associate cert. One of the modules asks that you download the customers.csv from github. I've since downloaded but receiving the following error after creating lake db and associated folders:…
asked 2024-06-14T19:14:00.3033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 40%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDB%3C/text%3E%3C/svg%3E)
Darrick B
0
Reputation points
commented 2024-06-18T05:01:41.26+00:00
Smaran Thoomu
12,100
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Synapse workspace deployment node-js error ERR_INVALID_ARG_TYPE
Hi I am working on a CI/CD DevOps pipeline for Synapse Analytics. The Synapse workspace is integrated in my git repo, and I want to use task 'Synapse Workspace Deployment' with operation 'validate' to generate the ARM templates. The task is configured as…
asked 2023-11-27T12:05:22.12+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 54%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Simon Plancke
25
Reputation points
edited a comment 2024-06-18T01:03:29.07+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(41.6, 1%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Abhinav Sundar Sajan Darsi
0
Reputation points
1 answer
ORA-12650: No common encryption or data integrity algorithm - connectivity error in Synapse.
Hi Team, We are using an Azure Self Hosted Integration Runtime to connect to an on-premise Oracle SQL Database, we had pipeline running everyday till yesterday before the west europe outage ( Ticket ID - RN9S-39Z ). Post the outage fix we have been…
asked 2024-06-12T09:18:51.3+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 84%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJA%3C/text%3E%3C/svg%3E)
Jayachandran, Athul
21
Reputation points
commented 2024-06-17T21:09:05.5966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
28,616
Reputation points Microsoft Employee
0 answers
Avoiding metric inflation during data processing in Dedicated SQL Pool (formerly SQL DW)
Hi all , Here is the scenario for which I am seeking suggestions: Whenever our data jobs run to refresh dimensions and facts, and a Tableau extract refresh occurs simultaneously, the extracts report inflated metrics. When we validate, the metrics on the…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 74%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Azure Synapse fails to load Lake Databases (500 error)
When loading a Synapse workspace, it sits at "loading resources" for awhile and eventually errors with a 500 for lake databases. The error is not particularly helpful. Any ideas on how I could potentially determine if it's a single data lake…
asked 2024-06-11T20:11:33.8566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 74%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETD%3C/text%3E%3C/svg%3E)
Timothy Dufrane
45
Reputation points
accepted 2024-06-17T13:58:15.3433333+00:00
Timothy Dufrane
45
Reputation points
1 answer
One of the answers was accepted by the question author.
Accessing Azure Synapse Dedicated SQL Pool Using PySpark Without Exposing Passwords
I want to create a notebook for processing data in a table from the database using PySpark, to be used later in a Databricks pipeline. I'm unsure how to read data from the existing database in the notebook without including my password. Here is my…
asked 2024-06-14T08:38:35.8933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 38%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVC%3C/text%3E%3C/svg%3E)
Vandrangi Charaz Kumar
40
Reputation points
accepted 2024-06-17T12:51:17.3066667+00:00
Vandrangi Charaz Kumar
40
Reputation points
1 answer
Updating Oracle on-premise table from a Synapse table
Hi, I need to update an Oracle on-premise table from a Synapse table by joining the Oracle table with the Synapse table avoiding to build a staging table on Oracle platform to copy the Synapse data. It is a problem to obtain the authorization from my…
asked 2024-06-01T12:00:58.09+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 41%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
pmscorca
877
Reputation points
commented 2024-06-17T12:49:14.95+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 5%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
ANIS ABIRIGA
0
Reputation points
2 answers
One of the answers was accepted by the question author.
Not able to fetch serverless sql db into azure synpase pipeline for copy data pool
Hello Community, I have created one serverless pool db in Synapse and am trying to connect this serverless sql db as a destination to get table from azure sql db. In the drop down , I am just getting my dedicated sql pool (dspcodemsynps) not…
asked 2024-06-13T13:08:30.7333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 24%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Ashish Asthana
40
Reputation points
answered 2024-06-17T12:43:14.7766667+00:00
Ashish Asthana
40
Reputation points