Auzure Synapse - REST Linked Service doesn't save Auth headers parameters after publish
Hello, I have a Synapse workspace and last Monday I have discovered this bug: 1.Synapse is in Synapse Live mode 2.Open Manage - Linked Services - New - select REST 3.Fill all required fields and select Authorization type "Anonymous" as shown…
'Token Authentication failed - MISE12034' Error while connecting to Serverless SQL pool created in Synapse Analytics workspace from psotman
Hi Team, I have created azure cosmos database with analytical store enabled (through azure synapse link). I am using built in sererless sql pool, I have created couple of views to access the data from analytical store. I want to access these view through…
Medallion in Synapse or Fabric?
I'm evaluating the Medallion architecture for a data lakehouse setup, and I am trying to decide whether Azure Synapse Analytics or Microsoft Fabric is better suited for implementing this architecture. I would appreciate insights into which platform…
Medallion Architecture
Hi Our company is trying to migrate to Synapse. Could you explain how the Medallion architecture can be implemented in Azure Synapse Analytics? Specifically, I'm interested in understanding the best practices for organizing data layers, leveraging…
SQL Server query fails in newer version with "VIEW DATABASE PERFORMANCE STATE permission denied" error, despite only requiring "VIEW DEFINITION" permission
I'm running a query in Synapse using the following tables: sys.query_store_plan, sys.query_store_query, and sys.query_store_query_text. This query executes successfully on SQL Server version 12.00.2531 with only the VIEW DEFINITION permission granted to…
SQL Query to calculate size of each schemas in Azure data warehouse and to find last access time?
Hi, Is there any SQL query that could help me get the size of each schemas present in our Azure Data Warehouse service and also to find when was it last accessed? I checked and found one query below which can help me find the size of each table in…
Azure Synapse support end
Hello- I have heard that Microsoft is going to end support for synapse.Is that true ? What if customers don't want to move to Microsoft Fabric? I believe it works on data mesh so that may not be suitable for all organisation. Thanks, Sourav
Missing and duplicate columns when fetching data from DynamicsCRM i azure synapse copy activity
Hi. When fetching data from Dynamics CRM and copying it to a DW, one of the columns appears in the preview data in the source of the copy activity, but it is not created in the DW ("LeadId"). Moreover, it doe not appear when importing schema…
Apache slf4j error when setting up spark pool
I am getting the following errors when my apache spark pool job is running. The main issue seems to be the slf4j error. How do I fix this: Picked up _JAVA_OPTIONS: -Djava.io.tmpdir=/mnt/tmp Picked up _JAVA_OPTIONS: -Djava.io.tmpdir=/mnt/tmp SLF4J:…
Primary file system container not visible for a Synapse Analytics workspace
Hi, I'm working with a Synapse workspace and I've noticed that in Synapse Studio, Data --> Linked --> Azure Data Lake Storage Gen2, isn't visible the primary file system container. This container is also not visible in the related ADLS Gen2. My…
Optimizing Azure Synapse Analytics for Spark Pool and Mapping Data Flows
I am encountering errors involving Livy sessions when running multiple pipelines in Synapse Notebook and mapping data flows. The errors are as follows: For notebooks: Operation on target forecast_constrained failed: Exception: Failed to create Livy…
Flatten a JSON Nested Array in Azure Synapse pipeline
I am trying to flatten a JSON which has nested array objects with 1:M mapping. Please refer below JSON response. { "result": [ { "data": [ { "dimensions": [ …
Apache Spark 3.3 will retire but Azure Synapse Link use spark pool for delta conversion only support Apache Spark 3.3
Received email from MS mentioned that Apache Spark 3.3 will retire soon but Azure Synapse Link use spark pool for delta conversion only support Apache Spark 3.3 Any advises on this ?
Always got same 'OutputDataConversionError.TypeConversionError' , even I remove the datetime column in output in the Synapse DW sql pool, and got same error after delete and recreated stream analystic.
Always got same 'OutputDataConversionError.TypeConversionError' , even I remove the datetime column in output in Synapse DW sql pool, and got same error after delete and recreated stream analystic. Stream Input is event hub, get dignostic log from azure…
Azure Synapse Link - Not creating tables in Synapse Analytics
Hi, I am changing from Export to Datalake via Dynamics to Azure Synapse Link as recommended by Microsoft since Export to Datalake is expiring this year. I can successfully select the FnO tables through the Azure Synpase Link which creates the data in…
How to improve synapse notebook performance while storing data to blob
I have created multiple cell in notebook and executing. Taking to much time to fetching data from particular path and store data into DB as well as blob. So how can I reduce the execution time??
![](https://techprofile.blob.core.windows.net/images/hAFzqf2_AwAAAAAAAAAAAA.png?8DB62B)
Data is missing from management API using service principle. ex: Advisor Recommendations
I have a requirement to load datasets from management.Azure.com (Management API), for example: Advisor Recommendations, Resources I have created a service principal in app registration and have been able to obtain the access token. However, when loading…
Open row source
nsnapshot.txt Hi, how to run json file on synapse workspace.. Tried with open row set but not working.. Pls share screenshot if sny
![](https://techprofile.blob.core.windows.net/images/UVyLn-Xlr0apNce5TRX1RA.png?8DBA3B)
Migrate and move pipelines created in azure data factory into synapse pipelines
Can we migrate and move pipelines created in azure data factory into synapse pipelines because we want everything to be in the same environment (synapse workspace environment) . Can we do it or not
How accessing to a serverless SQL pool with a Microsoft Entra user without the related login
Hi, I need to access to a serverless SQL pool with my Microsoft Entra user (with MFA). My user is a Synapse Administrator for the related Synapse workspace. In the pool I haven't any login built with my Microsoft Entra user. Using SSMS I cannot access to…