Azure Datawarehouse Performance Tuning
Hi..Am currently working on Azure Sql DB to Azure Datawarehouse migration.. After migration when I tired to run fact load sp am facing severe performance issue.. That sp which has while loop in it and it has to iterate for 7000+ plus times. For each and…
![](https://techprofile.blob.core.windows.net/images/6ac6d5cce09942beb1e4016b6deb8ccc.png)
Getting SSL certificate error while connecting to Synapse SQL pool from Databricks in Azure using JDBC
--------------------------------------------------------------------------- Py4JJavaError Traceback (most recent call last) <command-3031308706598466> in <module> 6 .option("tempDir",…
![](https://techprofile.blob.core.windows.net/images/VfQFAmOikEWfBHko2XlWTA.png?8D7F33)
There are no adventureworks tables in datawarehouse
Trying to create an azure datawarehouse using powershell and want to import sample adventureworks data in it using powershell. Passing samplename parameter as "AdventureworksLT". But when the Dataware house is created,there are no…
ADW : Any changes to HEAP in Gen3
Hi All, We are using HEAP for transient data and want to check with experts if there are any upcoming changes to HEAP in Gen3.
![](https://techprofile.blob.core.windows.net/images/VfQFAmOikEWfBHko2XlWTA.png?8D7F33)
Azure Synapse Analytics - Resource Class assignment to Active Directory Group
I've assigned resource_class to a specific Active Directory group, but the user within that group gets the default resource_class assigned when executing queries. User X is assigned to AD group Y. Y is assigned to 'mediumrc' but the execution…
![](https://techprofile.blob.core.windows.net/images/Xutcj04Niky_hAjlWBUYlQ.png?8D81CF)
Synapse not supporting pagination JPA
When trying pagination with spring data jpa; getting duplicate records from other page and some records are being skipped.
How to read a CSV file with Line break and Quotes through PolyBase in Synapse
Hi All, I have an automated source that generates Excel file with data that can contain line breaks or double quotes or some delimiter values. I am converting this Excel file to CSV using ADF Copy activity and to handle column delimiter in data i have…
SYNAPSE STUDIO- SQL POOL -(NEW)OPTIONS DISABLED
Hello Community, I have been facing error related to creation of new sql pool via synapse stuido. The (New) options is disabled over synapse studio. Please could anyone let me know why is the reason behind it. THanks, Deepak
ADF Copy activity using PolyBase fails to load "Date" type to Synapse
When loading Date type from a parquet file to Synapse with "Date" type via ADF Copy with PolyBase, the ADF throws the following error: { "errorCode": "2200", "message":…
Spark pool does not reflect the contents of requirements.txt
I have checked the Microsoft Learn description below and am trying to add the Python libraries to the Spark pool. https://video2.skills-academy.com/en-us/azure/synapse-analytics/spark/apache-spark-azure-portal-add-libraries I created…
![](https://techprofile.blob.core.windows.net/images/e4ef62ef7c7342408b57606b210cf95d.png)
![](https://techprofile.blob.core.windows.net/images/HxPEUev7nku_f7jzbru_3Q.png?8D8614)
Performance, Pros and Cons of using Logic Apps or Azure Data Factory for Orchestration of huge ADW and Performance, Pros and Cons of using ADFV2 Mapping Data Flows
Please share Performance, Pros and Cons of using Logic Apps or Azure Data Factory for Orchestration for huge ADW and Performance, Pros and Cons of using ADFV2 Mapping Data Flows
Data Disposal/Retirement in Azure Synapse
Can someone please let me know how to achieve data disposal/retirement in Azure Synapse Analytics (SQL DW) and how to ensure it is happening safely in Azure.
Setting password for contained users mapped to Azure AD identities
Hi, I'm implementing Azure Active Directory Authentication for users to get in and use Synapse Analytics (SQL DW). I have 2 questions they are as follows: The Azure AD method that I used was Azure Active Directory Password. Through…
Pause/Resume SQL Synapse using SSIS
Hello, We are working on creating an automation script where our SQL Synapse can be paused/resumed during a time window for cost savings. Basically we wanted to do it in SSIS using powershell becase we wanted to check if there are any queries running…
EdX Certified but not MCSA
I completed a couple of certifications on EdX a while ago. Received the Microsoft Applied Data Analytics and Microsoft Data Science Fundamentals certificates from them. MCSA: BI Reporting wasnt available at the time I completed the EdX certifications.…
![](https://techprofile.blob.core.windows.net/images/2fooggAAAwAAAAAAAAAAAA.png?8DC1D0)
time query in PowerBIP
Hello We have an SQL Server 2016 database with historical tables We would like to display this data in PowerBi Like this in SQL Server "select * from XXXXXXXXXX for system_time all" thank you for your reply. Olivier Diago …
Synapse Analytics: Trigger activation error. I can't activate any scheduled Trigger.
I'm working on Azure Synapse Analytics. It was working fine till yesterday when I decided to create a new Scheduled Trigger. I can create a new trigger and associate it with an existing pipeline. When I try to activate it by hitting the publish…
Password for Contained User in Synapse Analytics
Team, I'm unable to create password for a contained user in Azure Synapse Analytics (SQL DW), seems like this feature isn't available. Please confirm on this! The available option is to create a contained user without password. But after…
Column level security not working in Synapse Analytics
Hi Team, I tried to implement column level security on a table in synapse analytics by skipping one column that shouldn't be viewed by a specific user, but still this user is able to view this column from the table. The query I used to implement…
Alternative to using Azure SQL Managed Instance for Complex calculations
I have inherited an Architecture which carries out complex calculation in Azure SQL Managed Instance via Databricks. The Databricks is connected via Apache Spark connector. The Databricks does the calculations in SQL and the end results are in Tables…