4,825 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

Auzure Synapse - REST Linked Service doesn't save Auth headers parameters after publish

Hello, I have a Synapse workspace and last Monday I have discovered this bug: 1.Synapse is in Synapse Live mode 2.Open Manage - Linked Services - New - select REST 3.Fill all required fields and select Authorization type "Anonymous" as shown…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-09-04T07:30:25.59+00:00
Ilya Kutsenko 0 Reputation points
0 answers

'Token Authentication failed - MISE12034' Error while connecting to Serverless SQL pool created in Synapse Analytics workspace from psotman

Hi Team, I have created azure cosmos database with analytical store enabled (through azure synapse link). I am using built in sererless sql pool, I have created couple of views to access the data from analytical store. I want to access these view through…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-09-04T06:08:47.28+00:00
Jaydeep Suryawanshi 26 Reputation points
edited the question 2024-09-04T06:09:46.2633333+00:00
Jaydeep Suryawanshi 26 Reputation points
1 answer

Medallion in Synapse or Fabric?

I'm evaluating the Medallion architecture for a data lakehouse setup, and I am trying to decide whether Azure Synapse Analytics or Microsoft Fabric is better suited for implementing this architecture. I would appreciate insights into which platform…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-09-04T03:20:28.1033333+00:00
DataCoder 120 Reputation points
answered 2024-09-04T05:31:45.5566667+00:00
Vinodh247 16,436 Reputation points
1 answer

Medallion Architecture

Hi Our company is trying to migrate to Synapse. Could you explain how the Medallion architecture can be implemented in Azure Synapse Analytics? Specifically, I'm interested in understanding the best practices for organizing data layers, leveraging…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-09-03T14:24:52.8733333+00:00
DataCoder 120 Reputation points
commented 2024-09-04T03:18:22.6566667+00:00
DataCoder 120 Reputation points
2 answers

SQL Server query fails in newer version with "VIEW DATABASE PERFORMANCE STATE permission denied" error, despite only requiring "VIEW DEFINITION" permission

I'm running a query in Synapse using the following tables: sys.query_store_plan, sys.query_store_query, and sys.query_store_query_text. This query executes successfully on SQL Server version 12.00.2531 with only the VIEW DEFINITION permission granted to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,598 questions
asked 2024-09-02T05:47:17.2866667+00:00
Hamza Mohammad 0 Reputation points
commented 2024-09-03T21:55:11.0833333+00:00
Smaran Thoomu 14,140 Reputation points Microsoft Vendor
1 answer

SQL Query to calculate size of each schemas in Azure data warehouse and to find last access time?

Hi, Is there any SQL query that could help me get the size of each schemas present in our Azure Data Warehouse service and also to find when was it last accessed? I checked and found one query below which can help me find the size of each table in…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-08-29T11:37:15.3733333+00:00
Suraj Pardeshi 0 Reputation points
edited the question 2024-09-03T21:41:14.7666667+00:00
Bhargava-MSFT 30,406 Reputation points Microsoft Employee
1 answer

Azure Synapse support end

Hello- I have heard that Microsoft is going to end support for synapse.Is that true ? What if customers don't want to move to Microsoft Fabric? I believe it works on data mesh so that may not be suitable for all organisation. Thanks, Sourav

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-09-03T13:18:19.65+00:00
Sourav 100 Reputation points
edited an answer 2024-09-03T20:46:55.8266667+00:00
Bhargava-MSFT 30,406 Reputation points Microsoft Employee
0 answers

Missing and duplicate columns when fetching data from DynamicsCRM i azure synapse copy activity

Hi. When fetching data from Dynamics CRM and copying it to a DW, one of the columns appears in the preview data in the source of the copy activity, but it is not created in the DW ("LeadId"). Moreover, it doe not appear when importing schema…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-09-02T15:15:44.0533333+00:00
Catarina Leiria 0 Reputation points
commented 2024-09-03T18:45:01.5166667+00:00
Smaran Thoomu 14,140 Reputation points Microsoft Vendor
0 answers

Apache slf4j error when setting up spark pool

I am getting the following errors when my apache spark pool job is running. The main issue seems to be the slf4j error. How do I fix this: Picked up _JAVA_OPTIONS: -Djava.io.tmpdir=/mnt/tmp Picked up _JAVA_OPTIONS: -Djava.io.tmpdir=/mnt/tmp SLF4J:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-09-02T09:32:31.5366667+00:00
Daniel Pearson 20 Reputation points
commented 2024-09-03T16:11:07.9733333+00:00
NIKHILANETHIKUNTA 1,425 Reputation points Microsoft Vendor
1 answer

Primary file system container not visible for a Synapse Analytics workspace

Hi, I'm working with a Synapse workspace and I've noticed that in Synapse Studio, Data --> Linked --> Azure Data Lake Storage Gen2, isn't visible the primary file system container. This container is also not visible in the related ADLS Gen2. My…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-09-02T13:44:05.9+00:00
pmscorca 987 Reputation points
commented 2024-09-03T16:01:53.2566667+00:00
pmscorca 987 Reputation points
1 answer One of the answers was accepted by the question author.

Optimizing Azure Synapse Analytics for Spark Pool and Mapping Data Flows

I am encountering errors involving Livy sessions when running multiple pipelines in Synapse Notebook and mapping data flows. The errors are as follows: For notebooks: Operation on target forecast_constrained failed: Exception: Failed to create Livy…

Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
3,064 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,496 questions
asked 2024-08-29T08:21:28.3033333+00:00
Aditya Singh 130 Reputation points
accepted 2024-09-03T14:35:59.04+00:00
Aditya Singh 130 Reputation points
1 answer

Flatten a JSON Nested Array in Azure Synapse pipeline

I am trying to flatten a JSON which has nested array objects with 1:M mapping. Please refer below JSON response. { "result": [ { "data": [ { "dimensions": [ …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-08-29T18:01:41.31+00:00
sachin gupta 376 Reputation points
edited a comment 2024-09-03T14:10:20.1+00:00
Smaran Thoomu 14,140 Reputation points Microsoft Vendor
0 answers

Apache Spark 3.3 will retire but Azure Synapse Link use spark pool for delta conversion only support Apache Spark 3.3

Received email from MS mentioned that Apache Spark 3.3 will retire soon but Azure Synapse Link use spark pool for delta conversion only support Apache Spark 3.3 Any advises on this ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-08-13T00:46:23.4633333+00:00
Chan Zhen Seng - EYSI 0 Reputation points
commented 2024-09-03T14:05:28.7+00:00
Smaran Thoomu 14,140 Reputation points Microsoft Vendor
2 answers

Always got same 'OutputDataConversionError.TypeConversionError' , even I remove the datetime column in output in the Synapse DW sql pool, and got same error after delete and recreated stream analystic.

Always got same 'OutputDataConversionError.TypeConversionError' , even I remove the datetime column in output in Synapse DW sql pool, and got same error after delete and recreated stream analystic. Stream Input is event hub, get dignostic log from azure…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
351 questions
asked 2021-11-12T10:31:09.177+00:00
woodymoo 261 Reputation points
commented 2024-09-03T13:54:27.8766667+00:00
Frank Rasche 0 Reputation points
3 answers One of the answers was accepted by the question author.

Azure Synapse Link - Not creating tables in Synapse Analytics

Hi, I am changing from Export to Datalake via Dynamics to Azure Synapse Link as recommended by Microsoft since Export to Datalake is expiring this year. I can successfully select the FnO tables through the Azure Synpase Link which creates the data in…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-08-05T11:05:23.24+00:00
Daniel Pearson 20 Reputation points
accepted 2024-09-03T11:36:48.43+00:00
Daniel Pearson 20 Reputation points
1 answer One of the answers was accepted by the question author.

How to improve synapse notebook performance while storing data to blob

I have created multiple cell in notebook and executing. Taking to much time to fetching data from particular path and store data into DB as well as blob. So how can I reduce the execution time??

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,774 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,496 questions
asked 2024-08-21T13:16:50.36+00:00
Shrimathi M 40 Reputation points
commented 2024-09-03T09:54:34.8966667+00:00
Vinodh247 16,436 Reputation points
1 answer One of the answers was accepted by the question author.

Data is missing from management API using service principle. ex: Advisor Recommendations

I have a requirement to load datasets from management.Azure.com (Management API), for example: Advisor Recommendations, Resources I have created a service principal in app registration and have been able to obtain the access token. However, when loading…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,456 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,496 questions
Azure Advisor
Azure Advisor
An Azure personalized recommendation engine that helps users follow best practices to optimize Azure deployments.
58 questions
asked 2024-09-02T13:26:14.2+00:00
Mahesh Reddy 20 Reputation points
commented 2024-09-03T09:54:06.36+00:00
Vinod Kumar Reddy Chilupuri 0 Reputation points Microsoft Vendor
1 answer

Open row source

nsnapshot.txt Hi, how to run json file on synapse workspace.. Tried with open row set but not working.. Pls share screenshot if sny

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-09-02T15:47:54.2266667+00:00
Vineet S 710 Reputation points
answered 2024-09-03T07:22:17.34+00:00
Amira Bedhiafi 22,311 Reputation points
2 answers One of the answers was accepted by the question author.

Migrate and move pipelines created in azure data factory into synapse pipelines

Can we migrate and move pipelines created in azure data factory into synapse pipelines because we want everything to be in the same environment (synapse workspace environment) . Can we do it or not

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2021-08-18T22:26:58.953+00:00
NagaSri 26 Reputation points
edited the question 2024-09-03T02:53:42.26+00:00
Yan Xie 40 Reputation points Microsoft Employee
0 answers

How accessing to a serverless SQL pool with a Microsoft Entra user without the related login

Hi, I need to access to a serverless SQL pool with my Microsoft Entra user (with MFA). My user is a Synapse Administrator for the related Synapse workspace. In the pool I haven't any login built with my Microsoft Entra user. Using SSMS I cannot access to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,825 questions
asked 2024-08-27T09:04:32.7833333+00:00
pmscorca 987 Reputation points
commented 2024-09-02T17:00:33.0033333+00:00
phemanth 9,845 Reputation points Microsoft Vendor