Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,858 questions
1 answer
One of the answers was accepted by the question author.
How to implement Retention Policies in Azure Synapse Analytics (Azure SQL Data Warehouse) ?
Trying to understand how to implement Retention Policies in Azure Synapse Analytics (Azure SQL Data Warehouse). There isn't enough supporting material on the steps to implement retention policies in Azure Synapse Analytics/ SQL Data Warehouse. Does…
asked 2020-07-21T01:37:43.19+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 21%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENP%3C/text%3E%3C/svg%3E)
Neil Pereira
81
Reputation points
accepted 2020-08-05T16:08:00.983+00:00
Neil Pereira
81
Reputation points
1 answer
How to pass column list as argument from databricks spark for copy write semantic
Is there a way to pass column list argument for column mapping between spark and synapse table from databricks spark for write semantics as copy as we pass it while running copy command from synapse?
asked 2020-07-23T06:54:16.693+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 43%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
Rishabh
11
Reputation points
commented 2020-08-05T00:32:38.243+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,471
Reputation points Microsoft Employee
1 answer
How big is "Not Big Enough" for Synapse?
We are looking to move our data warehouse to the cloud. We don't have "big data". The biggest table we have has 200 millions rows. Is it cost effective to run a small data warehouse in Synapse? Is there a scenario that exists where you would…
asked 2020-07-26T17:33:53.627+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 9%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJM%3C/text%3E%3C/svg%3E)
John Mihalko
1
Reputation point
commented 2020-07-31T14:43:39.797+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 9%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HarithaMaddi-MSFT
10,136
Reputation points
1 answer
One of the answers was accepted by the question author.
How to insert data in Azure Synapse Analytics through Azure Data factory without PolyBase
I have tried using Move and Transfar activity in data factory but I'm getting 2 error at publishing: ' Data flow activity 'dataflow1' requires a stagingLinkedService Data flow activity 'dataflow1' requires a stagingStoragePath ' I don't want to…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 95%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMD%3C/text%3E%3C/svg%3E)
2 answers
Synapse updating the data lake json file?
is it possible to update the json file from synapse? After reading, i need to update the json rows. When i tried to update/delete the json through external table, it's error out with, won't support the DML operation. Kindly advise how to achieve…
asked 2020-07-16T20:01:09.163+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 55.00000000000001%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EE%3C/text%3E%3C/svg%3E)
ever
1
Reputation point
answered 2020-07-29T15:16:33.61+00:00
Girijesh Pandey
1
Reputation point
3 answers
One of the answers was accepted by the question author.
Azure data lake storage Gen2 error external location not found
I used COPY INTO statement to copy csv file in ADLS Gen2 to Synapse table successfully with share access signature as credential. However, when I try to copy snappy.parquet file in the same storage account (different container) into a table in the same…
asked 2020-07-17T21:04:55.303+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(160, 2%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELF%3C/text%3E%3C/svg%3E)
Larry Feng
21
Reputation points
answered 2020-07-29T14:43:14.813+00:00
Girijesh Pandey
1
Reputation point
2 answers
Architectual Question (ADLS, Azure Synapse, AAS, Power BI)
We are using the following: Source data stored in ADLS (Blob Storage) Azure Synapse (sort of a staging layer) Azure Analysis Services (semantic layer) Power BI (for users to create their own vizualizations based on the AAS semantic layer) …
asked 2020-07-26T20:46:49.767+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 80%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJH%3C/text%3E%3C/svg%3E)
james.h.robinson.csm@gmail.com
6
Reputation points
commented 2020-07-28T14:32:07.89+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 70%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESN%3C/text%3E%3C/svg%3E)
Saubhagya Nayak
1
Reputation point
1 answer
One of the answers was accepted by the question author.
is cetas refreshed automatically
sorry for the basic question, I just created a new CETAS (external table as a select) using azure synapse on demand, when the data source change will CETAS refresh automatically , or how to refresh a CETAS ?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 48%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
1 answer
Unable to load timestamp (Hexadecimal) from Azure SQL to Azure Synapse
Hi, I have been trying to load table from Azure SQL to Azure synapse (formerly Azure DW) using Azure Data Factory. However, it is failing with a timestamp column, which has hexadecimal values. Timestamp is not supported in Azure Synapse and it…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 0%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
2 answers
Is it possible to Read CSV files where description has a quote (not delimited by quotes) in Synapse SQL On Demand?
Hello, my question is very sample if have the following CSV file in my datalake |Id|Description |1|my description |2| descry 3 " inches is it possible to use TSQL BULK an openquery to read the above content? Thank you so much
asked 2020-07-02T21:33:17.08+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 13%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
silvan
1
Reputation point
commented 2020-07-24T20:33:14.72+00:00
HimanshuSinha-msft
19,471
Reputation points Microsoft Employee
1 answer
Infer parquet schema to create table in SQL pool
hi, I am evaluating Synapse analytics (in preview) and need to create tables in Synapse sql pool from parquet files, stored in ADLS gen2. I would like to avoid creating tables manually in sql pool as my parquet files already have a schema with…
asked 2020-07-15T14:03:33.717+00:00
Boris Tyukin
1
Reputation point
commented 2020-07-24T20:24:06.15+00:00
HimanshuSinha-msft
19,471
Reputation points Microsoft Employee
1 answer
Error at create spark database in synapse workspace notebook using orchestrate pipeline.
I'm getting below error while running synapse notebook from orchestrate in synapse workbook. My notebook runs fine when ran individually from Develop. I gave Owner and Storage Blob Data Owner role to myself before running the pipeline as mentioned in…
asked 2020-07-21T07:01:54.63+00:00
Rishabh
11
Reputation points
commented 2020-07-23T22:04:55.32+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT
26,081
Reputation points
1 answer
How do we add user to synapse analytics workspace ?
Hi, How do i add AAD user to a specific Synapse Analytics Workspace. At the moment it is showing only SQL Pool Admin, Spark Admin and Workspace Admin. I want to just add end user to a workspace so that they can work with it. In Azure Databricks we…
asked 2020-07-13T14:14:27.267+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 79%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAD%3C/text%3E%3C/svg%3E)
Anbu.Dhanushkodi
1
Reputation point
commented 2020-07-23T07:49:05.83+00:00
Rishabh
11
Reputation points
1 answer
What should I put the "Host" while linking the Oracle Service Cloud to Azure Synapse Analytics?
I want to link the Oracle Service Cloud to Azure Synapse Analytics portal, but I am not getting what should be the "Host" 12296-screenshot-65.png
asked 2020-07-15T05:54:59.867+00:00
Pallav Kulkarni
1
Reputation point
commented 2020-07-21T20:49:07.15+00:00
HimanshuSinha-msft
19,471
Reputation points Microsoft Employee
1 answer
Managed Identity link between ADLSGen2 and Synapse External datasource
Hello Team, I need to create an external data source to ADLSGen2 in Azure synapse. The methods through which we can create is Access key SAS Is there any way I can create an external data source in synapse via Managed identity functionality…
asked 2020-07-02T07:08:42.27+00:00
Nandan Hegde
32,026
Reputation points MVP
commented 2020-07-20T11:33:37.653+00:00
PRADEEPCHEEKATLA-MSFT
88,716
Reputation points Microsoft Employee
0 answers
Unable to link Oracle Cloud Service to Azure Synapse
I am trying to link Oracle Cloud Service to Azure Synapse Workspace. I have created Integration runtime, filled the hostname, but I am getting the error message while testing the connection: ERROR [HY000] [Microsoft][OSvC] (100) Error parsing JSON:…
asked 2020-07-15T03:32:37.22+00:00
Pallav Kulkarni
1
Reputation point
commented 2020-07-16T23:23:16.653+00:00
HimanshuSinha-msft
19,471
Reputation points Microsoft Employee
1 answer
Synapse Analytics - Unable to start cluster when I upload requirements.txt file - cluster fails.
Hi, I'm trying to start a cluster with some additional packages (tried output of pip freeze > requirements.txt and also added all of the packages that come with the anaconda distribution that is installed on standard cluster in synapse analytics). …
asked 2020-05-26T02:09:14.497+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 28.999999999999996%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJK%3C/text%3E%3C/svg%3E)
Joe Kastner
21
Reputation points
commented 2020-07-08T22:36:45.097+00:00
Mike Ubezzi
2,776
Reputation points
3 answers
Version of Synapse Analytics
I'm having a question; I'm having 2 SQL DW / Synapse databases (dev + uat) and a few things that I see is a difference in version. I started figuring this out because of that DEV supported a Common Table Expression with an insert and UAT doesn't... So it…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 63%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
2 answers
ADF V2 failed activity
On June17th when an stored procedure activity failed, anything that was written to output (aka Print) in the stored procedure was included in the error in ADF. Since July 1st this no longer is included in the output. Is there a way we can get this…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 32%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
2 answers
Intellisense - difference between Python and Scala
I noticed that Intellisense (auto-complete) in Scala cells is less intelligent compared to Python cells. In Python it is aware of the object type and functions/objects available in scope, but in Scala it offers only the generic Scala operators, not aware…
asked 2020-06-11T04:01:31.337+00:00
Dimitri B
66
Reputation points
answered 2020-07-07T18:12:44.59+00:00
HimanshuSinha-msft
19,471
Reputation points Microsoft Employee