azure database, user have database level permission, and then grant schema level permission ,what will happen?
hi friend, we use azure Synapse type database. i found two principals (called A and B )have been granted control/execute/connect permission on database level. now i want to granting 'select' permission on schema(called SC) to principal A, what will…
VS2017 - SSIS Project
Hello Team, We are using VS2017 with SSDT installed (PFB the screenshot) We cannot find BI projects, unable to create SSIS projects. Please advice. Regards, Nagesh CL
How to migrate data from Azure databases to the container of storage accounts?
hi friends, i want to migrate data from two databases of azure synapse analytics to my ADLS2 container.What is a simple and efficient way? Thanks
How may we change the default "Undeliverable..." subject and "wasn't found"-message auto-reply?
How may we change the default "Undeliverable..." subject and "wasn't found"-message auto-reply? "Undeliverable: [...]" and a default content message when opened reading "Your message to johndoe@thedomain.org couldn't…
pyspark merge dataframe issue
I am trying to merge multiple files using merge schema command in pyspark and i get the the following error. The pipeline runs every one hour. The merge schema works fine some times and it fails sometime. I am using the following command. df =…
I can't do multiple unroll in flatten activity synapse dataflow
It was working quite well before, And started failing with "none.get" which is no where helping me to find the root cause, Even though I figured out that multiple flatten Unroll by cause the issue. My source is multiple Nested JSON try to…
What causes javascript error 'Response is not defined' for Synapse Analytics deployment command validate, task 'Synapse workspace deployment@2'
Hi I would really appreciate some help with a build failure in ADO build pipeline. We haven't changed the underlying code base, and the node.js version is the same as the last successful build. This ADO build yaml snippet installs node.js and then…
Granting the view permission for a stored procedure in a Synapse SQL pool
Hi, in a dedicated Synapse SQL pool is it to possible granting the view (and not the execution) permission for a stored procedure? Thanks
Azure Data Bricks - User Doesn't have permission to perform this action while connecting to Azure Synapse Dedicate Pool
We are connecting Azure Synapse Analytics - Dedicated Pool using the PySpark Code that runs from Azure Data Bricks using SQL Authentication. While running, we are getting the below error when we use a user with db_datawriter and db_datareader…
Azure synapse link creates model.json with no partitions
Hi, I am following this link below to copy dataverse data to Azure SQL DB using azure data factory pipelines. The model.json file created by my synapse link for dataverse is correctly creating the schema and attribute names for all the tables/entities.…
Azure Synapse analytics with CosmosDB query is giving null values
Hi Team, we are storing data in Azure cosmos db for mongo and trying to query from Azure synapse serverless pool.when we query with Query items with full fidelity schema we are getting the values else we are getting string:value. can you please help us…
vm cpu utilization
Hi, have 100 VMs in Azure portal's resource group for which i am running VM memory metrix(cpu usage) .. how can it will automatically recognized the new subscription of vm came so that it will show the cpu usage via loading adf or databricks pipeline
Spark job definition with blob fileName and folderPath is not working
I have a spark job definition in python file and passing the blob fileName and folderPath as parameters using Dynamic Content and Pipeline expression builder. I have defined the parameters as follow fileName default value to…
Spark 3.3 version upgrade getting fail with Error : Failure(java.lang.ClassNotFoundException: Failed to find data source: com.microsoft.sqlserver.jdbc.spark. Please find packages athttps://spark.apache.org/third-party-projects.html )
Dear Support-Team, As we aware Spark 3.2 version going to decommission from July 8, so, we are planning to upgrade our spark pools from 3.2 to 3.3 version. Fyi, we are maintaining metadata in Microsoft SQL Server. while using spark 3.2 version in azure…
Azure Synapse Link for dataverse to bring Dynamics 365 data to ADLS and Synapse for analytical purpose - Facing Issues and inconsistencies in the feature
We are using Synapse Link for Dataverse feature to bring dynamics 365 data to ADLS and Synapse Analytics. We have below open issues due to which we are unable to finalize the solution: In F&O linked dataverse environment, we have created a synapse…
PowerBI fails to connect to Azure Synapse works with SQL login
0 I am connecting to a synapse SQL database from powerBI, this is using a data gateway. If I use SQL authentication, it works fine however if i change it to OAuth authentication, I get the error below. Unable to create connection for the following…
unable to delete the Apache Spark pool in Azure Synapse Analytics
unable to delete the Apache Spark pool and attached error messages. I tried to delete via powershell as well from Azure Cloud Shell but no luck. As you can see in the screenshot there is no notebook1.
Reading sql pool auditing files (.xel)
I am trying to read audit files in Synapse analytics, made by automated auditing, using query select * from sys.fn_get_audit_file('https://datalake.dfs.core.windows.net/path/10_00_24_565_6.xel' ,DEFAULT ,DEFAULT ); But it just gives me empty…
Mssparkutils.credentials.getSecretWithLS to get Certificate and create CertificateCredential in Synapse
I need to create a CertificateCredential from azure.identity, I have a PKCS12 certificate saved in a Key Vault and I am reading it using mssparkutils with LinkedService, official documentation mentioned you can create a CertificateCredential with the…
Facing spark.kryoserializer.buffer.max overflow error in Azure Synapse Notebook. How to overcome this?
I am facing spark.kryoserializer.buffer.max overflow error in Synapse Notebook having transformation steps. My Notebook creates dataframes and Temporary Spark SQL Views and there are around 12 steps using JOINS. The number of records being transformed…