Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,903 questions
0 answers
Serverless SQL pool has encountered an internal error
I created a Synapse Workspace, and whenever I try to create a new SQL script I receive this error. Unfortunately the message is extremely vague, so I cannot provide more details. I researched online and only found this question being asked here…
asked 2022-02-25T02:07:52.36+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 12%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFG%3C/text%3E%3C/svg%3E)
Fillipe Goulart
1
Reputation point
commented 2024-09-28T19:31:46.7333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 74%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETS%3C/text%3E%3C/svg%3E)
Tarunoday Sharma
0
Reputation points
2 answers
Suggest a way to replicate data from on premise sql server 2019 to azure synaspe analytics directly
Im using an sql server in my on premise with version 2019, I need to transfer or replicate real time data to azure synapse database, so which azure service will be more effective and flexible for large data transfer
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 81%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
1 answer
Can the Dedicated SQL pool be backed up to Azure Blob Storage using any available method?
This question explores the possibility of backing up a Dedicated SQL pool, part of Azure Synapse Analytics, to Azure Blob Storage. It seeks to understand whether there are mechanisms, tools, or processes available to facilitate this backup, ensuring data…
asked 2024-09-28T14:17:35.4366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 62%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENP%3C/text%3E%3C/svg%3E)
Nithin Prince John
0
Reputation points
commented 2024-09-28T16:35:16.34+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 38%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
Marcin Policht
23,160
Reputation points MVP
0 answers
Azure Synapse API returns empty array with filters in POST request, but works without them
I'm trying to query pipeline runs in Azure Synapse using the Synapse REST API (queryPipelineRuns). When I make a POST request without filters in the body, it works and returns the expected pipeline runs. However, when I add filters such as…
asked 2024-09-28T12:02:25.2366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 44%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
sultan khan
0
Reputation points
asked 2024-09-28T12:02:25.2366667+00:00
sultan khan
0
Reputation points
1 answer
Power BI failing with Bulk Load failed error
Power BI refreshes failing with the following error - Microsoft SQL: Cannot bulk load because the file…
asked 2024-09-27T17:40:48.4966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 90%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELD%3C/text%3E%3C/svg%3E)
Lohit Dacha
0
Reputation points
answered 2024-09-28T04:09:25.9+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
15,520
Reputation points Microsoft Vendor
0 answers
Synapse Serverless SQL external table returns old data
An external table created in a Synapse Serverless SQL pool for an Azure Storage account Delta Table is not showing the data as it is in the Delta table. When the external table was initially created the data in the table was incorrect. The decision was…
asked 2024-09-27T11:01:11.09+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 13%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENS%3C/text%3E%3C/svg%3E)
Nelia Steenkamp
0
Reputation points
commented 2024-09-27T21:56:15.6466667+00:00
Smaran Thoomu
15,520
Reputation points Microsoft Vendor
0 answers
Serverless SQl pool has encountered an internal error
Hi all, I am getting this error while trying to run a simple query on an csv file connected to azure synapse studio via linked service; Serverless SQl pool has encountered an internal error Below is the error message from synapse studio. I did google…
asked 2024-09-27T18:47:07.9966667+00:00
Tarunoday Sharma
0
Reputation points
edited the question 2024-09-27T21:39:02.0766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 6%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKD%3C/text%3E%3C/svg%3E)
Keshavulu Dasari
520
Reputation points Microsoft Vendor
0 answers
How to lift and shift huge on premise data warehouse to azure synapse dedicated SQL pool
Cannot find any proper document or way to lift and shift on premise database to azure synapse dedicated SQL pool . Is it not possible to do it directly?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 13%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDR%3C/text%3E%3C/svg%3E)
1 answer
How to fix OLE DB provider 'STREAM' for linked server '(null)' returned invalid data for column '[!BulkInsert]' error?
I'm running a synapse pipeline to copy data from ODBC database to an Azure SQL Database. However, I'm seeing an error that suggests there might be invalid data causing the pipeline to fail. I'm auto-creating the table at the sink, so theoretically the…
asked 2024-09-25T12:40:36.9766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 85%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMT%3C/text%3E%3C/svg%3E)
Muhammad Tayyab Majeed
0
Reputation points
commented 2024-09-27T17:14:03.23+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
320
Reputation points Microsoft Vendor
0 answers
Unable to access oracle database from a port using SSL Certificate from Synapse
Hello - I am struggling to get something working. Here's the setup: Use synapse to connect to Oracle OCI database - using port 1521 no encryption and is working fine Oracle dba creating a new port 2484 which is encrypted Azure team received the…
asked 2024-09-24T14:26:11.63+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 46%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EXM%3C/text%3E%3C/svg%3E)
Xhevahir Mehalla
25
Reputation points
edited a comment 2024-09-27T15:01:03.28+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
10,330
Reputation points Microsoft Vendor
1 answer
Connect to eventhub using Managed service identity (MSI) from Azure synapse analytics using pyspark spark streaming
I am trying to write data to Azure Event Hubs from an Azure Synapse Analytics notebook in PySpark using Managed Service Identity (MSI). Could you please provide step-by-step guidance on how to achieve this, along with the necessary code? Please note, I…
asked 2024-09-26T05:45:48.2766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 82%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESY%3C/text%3E%3C/svg%3E)
Sunil Yadav
0
Reputation points
answered 2024-09-27T14:04:08.7333333+00:00
Sunil Yadav
0
Reputation points
0 answers
Encrypt data on transit - Oracle OCI to Azure Synapse -
Hello - We are implementing a solution like this: Extract data from Oracle OCI database use Azure Synapse Analytics Store Data to Data lake gen 2 We have created linked service in Synapse to connect to oracle OCI db We have been asked how to make…
asked 2024-09-20T07:19:30.7633333+00:00
Xhevahir Mehalla
25
Reputation points
commented 2024-09-27T13:54:38.1333333+00:00
phemanth
10,330
Reputation points Microsoft Vendor
1 answer
How to Set Up Automatic D365 Finance and Operations Data Replication to Azure Data Lake for Reporting?
Hi everyone, We have a D365 Finance and Operations environment hosted in the Central US region. Our Accounts Receivable (AR) data, including customers and invoices, is integrated from an on-premises Oracle database into D365 FinOps. I would like to…
asked 2024-09-04T14:06:33.1033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 95%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENP%3C/text%3E%3C/svg%3E)
Nitin Patil
20
Reputation points
commented 2024-09-27T13:52:33.49+00:00
phemanth
10,330
Reputation points Microsoft Vendor
1 answer
Datalake to Synapse pipeline failure
Hi, My pipeline is failing with below error when copying data from Datalake Gen 2 to Synapse dedicated pool. { "errorCode": "2200", "message":…
asked 2024-09-24T12:15:45.28+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 17%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGT%3C/text%3E%3C/svg%3E)
Girish Tharwani
0
Reputation points
commented 2024-09-27T11:56:28.5533333+00:00
Ganesh Gurram
320
Reputation points Microsoft Vendor
1 answer
ADF - converting list of lists into a proper JSON format
Hello, I'm pretty new to ADF and I can't wrap my head around one case. To keep it simple: I have a source (REST API response), which theoretically is JSON but it doesn't have a "proper" JSON format. It's supposed to be a simple table but it…
asked 2024-09-25T18:29:34.62+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 22%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPS%3C/text%3E%3C/svg%3E)
Patryk Sobczak
0
Reputation points
commented 2024-09-27T11:04:01.97+00:00
phemanth
10,330
Reputation points Microsoft Vendor
1 answer
Linked serice parameterization for azure synapse
Hi, I have an azure data lake gen 2 linked service created with storage account access and template parameter definitions. Json file set with below structure for linked services. I want to parameterise url and secret name of this linked service through…
asked 2024-09-26T06:44:11.3866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 0%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
shehan madusanka
0
Reputation points
edited an answer 2024-09-27T10:52:20.4333333+00:00
PRADEEPCHEEKATLA-MSFT
89,291
Reputation points Microsoft Employee
0 answers
Passing values from notebook to 'Set Variable' transformation within pipeline.
I have a synapse notebook in which I return a json string using: ... variables_dict = { "adlspath": adlspath, "MDPKeyVault": MDPKeyVault, "jdbcHostname": jdbcHostname, "jdbcDatabase":…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 33%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPO%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
differnce between synapse and databricks
What are major difference between synapse and data bricks and under what circumstances one should use synapse and vice versa
asked 2021-10-12T08:45:54.76+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 34%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Shivam Ramola
66
Reputation points
commented 2024-09-27T09:33:53.17+00:00
Suketu Nayak
10
Reputation points
1 answer
Synapse Workspace Common Data Model
Hi Team, We were referring to the database templates provided for common data model. We wanted to get the entities and attributes related to Supply chain and were unable to find the same. There Git repo seems to have a different set of entities. E.g.,…
asked 2024-09-26T12:04:41.8066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(92.8, 6%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPS%3C/text%3E%3C/svg%3E)
Preethi Sankaranarayanan
0
Reputation points
edited a comment 2024-09-27T09:04:18.16+00:00
Preethi Sankaranarayanan
0
Reputation points
1 answer
pyspark notebook: dedicated pool table to pandas dataframe
Hello, I have a table in the dedicated pool, I need to read this table into a pandas dataframe to do some calculation Is this posible ? Thanks
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 18%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJZ%3C/text%3E%3C/svg%3E)