Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
1 answer
One of the answers was accepted by the question author.
Replicated Table Distribution for Small Deployment
Microsoft design guidance suggests using a replicated distribution for small dimensions, such as date. For small service tiers, e.g., less than DW1000 where there is only one compute node allocated, does this selection still have positive impacts on…
asked 2020-07-13T22:29:12.963+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 14.000000000000002%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Matt
21
Reputation points
commented 2020-08-12T08:08:24.613+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 9%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HarithaMaddi-MSFT
10,136
Reputation points
2 answers
how azure synapse on demand calculate data processed ?
for testing purpose I am using a small parquet file, it is only 1.2 MB, but I notice when I check the data processed metrics, I see numbers like 12 mb. my question is does On demand mode for Azure Synapse charge for the compressed data or uncompressed
asked 2020-07-26T03:53:31.203+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 48%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
mim
26
Reputation points
answered 2020-08-10T11:33:08.577+00:00
HarithaMaddi-MSFT
10,136
Reputation points
1 answer
One of the answers was accepted by the question author.
How to setup data retention for Azure synapse analytics?
How do we delete/archive data older than certain time period in Azure synapse Analytics?
asked 2020-07-30T14:53:52.82+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 86%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJV%3C/text%3E%3C/svg%3E)
Jaswanth Vankayalapati
21
Reputation points
accepted 2020-08-05T19:33:33.577+00:00
Jaswanth Vankayalapati
21
Reputation points
1 answer
One of the answers was accepted by the question author.
How to implement Retention Policies in Azure Synapse Analytics (Azure SQL Data Warehouse) ?
Trying to understand how to implement Retention Policies in Azure Synapse Analytics (Azure SQL Data Warehouse). There isn't enough supporting material on the steps to implement retention policies in Azure Synapse Analytics/ SQL Data Warehouse. Does…
asked 2020-07-21T01:37:43.19+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 21%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENP%3C/text%3E%3C/svg%3E)
Neil Pereira
81
Reputation points
accepted 2020-08-05T16:08:00.983+00:00
Neil Pereira
81
Reputation points
1 answer
How to pass column list as argument from databricks spark for copy write semantic
Is there a way to pass column list argument for column mapping between spark and synapse table from databricks spark for write semantics as copy as we pass it while running copy command from synapse?
asked 2020-07-23T06:54:16.693+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 43%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
Rishabh
11
Reputation points
commented 2020-08-05T00:32:38.243+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
1 answer
How big is "Not Big Enough" for Synapse?
We are looking to move our data warehouse to the cloud. We don't have "big data". The biggest table we have has 200 millions rows. Is it cost effective to run a small data warehouse in Synapse? Is there a scenario that exists where you would…
asked 2020-07-26T17:33:53.627+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 9%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJM%3C/text%3E%3C/svg%3E)
John Mihalko
1
Reputation point
commented 2020-07-31T14:43:39.797+00:00
HarithaMaddi-MSFT
10,136
Reputation points
1 answer
One of the answers was accepted by the question author.
How to insert data in Azure Synapse Analytics through Azure Data factory without PolyBase
I have tried using Move and Transfar activity in data factory but I'm getting 2 error at publishing: ' Data flow activity 'dataflow1' requires a stagingLinkedService Data flow activity 'dataflow1' requires a stagingStoragePath ' I don't want to…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 95%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMD%3C/text%3E%3C/svg%3E)
2 answers
Synapse updating the data lake json file?
is it possible to update the json file from synapse? After reading, i need to update the json rows. When i tried to update/delete the json through external table, it's error out with, won't support the DML operation. Kindly advise how to achieve…
asked 2020-07-16T20:01:09.163+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 55.00000000000001%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EE%3C/text%3E%3C/svg%3E)
ever
1
Reputation point
answered 2020-07-29T15:16:33.61+00:00
Girijesh Pandey
1
Reputation point
3 answers
One of the answers was accepted by the question author.
Azure data lake storage Gen2 error external location not found
I used COPY INTO statement to copy csv file in ADLS Gen2 to Synapse table successfully with share access signature as credential. However, when I try to copy snappy.parquet file in the same storage account (different container) into a table in the same…
asked 2020-07-17T21:04:55.303+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(160, 2%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELF%3C/text%3E%3C/svg%3E)
Larry Feng
21
Reputation points
answered 2020-07-29T14:43:14.813+00:00
Girijesh Pandey
1
Reputation point
2 answers
Architectual Question (ADLS, Azure Synapse, AAS, Power BI)
We are using the following: Source data stored in ADLS (Blob Storage) Azure Synapse (sort of a staging layer) Azure Analysis Services (semantic layer) Power BI (for users to create their own vizualizations based on the AAS semantic layer) …
asked 2020-07-26T20:46:49.767+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 80%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJH%3C/text%3E%3C/svg%3E)
james.h.robinson.csm@gmail.com
6
Reputation points
commented 2020-07-28T14:32:07.89+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 70%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESN%3C/text%3E%3C/svg%3E)
Saubhagya Nayak
1
Reputation point
1 answer
One of the answers was accepted by the question author.
is cetas refreshed automatically
sorry for the basic question, I just created a new CETAS (external table as a select) using azure synapse on demand, when the data source change will CETAS refresh automatically , or how to refresh a CETAS ?
1 answer
Unable to load timestamp (Hexadecimal) from Azure SQL to Azure Synapse
Hi, I have been trying to load table from Azure SQL to Azure synapse (formerly Azure DW) using Azure Data Factory. However, it is failing with a timestamp column, which has hexadecimal values. Timestamp is not supported in Azure Synapse and it…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 0%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
2 answers
Is it possible to Read CSV files where description has a quote (not delimited by quotes) in Synapse SQL On Demand?
Hello, my question is very sample if have the following CSV file in my datalake |Id|Description |1|my description |2| descry 3 " inches is it possible to use TSQL BULK an openquery to read the above content? Thank you so much
asked 2020-07-02T21:33:17.08+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 13%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
silvan
1
Reputation point
commented 2020-07-24T20:33:14.72+00:00
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
1 answer
Infer parquet schema to create table in SQL pool
hi, I am evaluating Synapse analytics (in preview) and need to create tables in Synapse sql pool from parquet files, stored in ADLS gen2. I would like to avoid creating tables manually in sql pool as my parquet files already have a schema with…
asked 2020-07-15T14:03:33.717+00:00
Boris Tyukin
1
Reputation point
commented 2020-07-24T20:24:06.15+00:00
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
1 answer
Error at create spark database in synapse workspace notebook using orchestrate pipeline.
I'm getting below error while running synapse notebook from orchestrate in synapse workbook. My notebook runs fine when ran individually from Develop. I gave Owner and Storage Blob Data Owner role to myself before running the pipeline as mentioned in…
asked 2020-07-21T07:01:54.63+00:00
Rishabh
11
Reputation points
commented 2020-07-23T22:04:55.32+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT
26,051
Reputation points
1 answer
How do we add user to synapse analytics workspace ?
Hi, How do i add AAD user to a specific Synapse Analytics Workspace. At the moment it is showing only SQL Pool Admin, Spark Admin and Workspace Admin. I want to just add end user to a workspace so that they can work with it. In Azure Databricks we…
asked 2020-07-13T14:14:27.267+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 79%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAD%3C/text%3E%3C/svg%3E)
Anbu.Dhanushkodi
1
Reputation point
commented 2020-07-23T07:49:05.83+00:00
Rishabh
11
Reputation points
1 answer
What should I put the "Host" while linking the Oracle Service Cloud to Azure Synapse Analytics?
I want to link the Oracle Service Cloud to Azure Synapse Analytics portal, but I am not getting what should be the "Host" 12296-screenshot-65.png
asked 2020-07-15T05:54:59.867+00:00
Pallav Kulkarni
1
Reputation point
commented 2020-07-21T20:49:07.15+00:00
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
1 answer
Managed Identity link between ADLSGen2 and Synapse External datasource
Hello Team, I need to create an external data source to ADLSGen2 in Azure synapse. The methods through which we can create is Access key SAS Is there any way I can create an external data source in synapse via Managed identity functionality…
asked 2020-07-02T07:08:42.27+00:00
Nandan Hegde
30,716
Reputation points MVP
commented 2020-07-20T11:33:37.653+00:00
PRADEEPCHEEKATLA-MSFT
84,381
Reputation points Microsoft Employee
0 answers
Unable to link Oracle Cloud Service to Azure Synapse
I am trying to link Oracle Cloud Service to Azure Synapse Workspace. I have created Integration runtime, filled the hostname, but I am getting the error message while testing the connection: ERROR [HY000] [Microsoft][OSvC] (100) Error parsing JSON:…
asked 2020-07-15T03:32:37.22+00:00
Pallav Kulkarni
1
Reputation point
commented 2020-07-16T23:23:16.653+00:00
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
1 answer
Synapse Analytics - Unable to start cluster when I upload requirements.txt file - cluster fails.
Hi, I'm trying to start a cluster with some additional packages (tried output of pip freeze > requirements.txt and also added all of the packages that come with the anaconda distribution that is installed on standard cluster in synapse analytics). …
asked 2020-05-26T02:09:14.497+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 28.999999999999996%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJK%3C/text%3E%3C/svg%3E)
Joe Kastner
21
Reputation points
commented 2020-07-08T22:36:45.097+00:00
Mike Ubezzi
2,776
Reputation points