4,614 questions with Azure Synapse Analytics tags

Sort by: Updated
2 answers

azure database, user have database level permission, and then grant schema level permission ,what will happen?

hi friend, we use azure Synapse type database. i found two principals (called A and B )have been granted control/execute/connect permission on database level. now i want to granting 'select' permission on schema(called SC) to principal A, what will…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-26T08:23:08.6666667+00:00
Huang, Winston-HR 300 Reputation points
answered 2024-06-27T07:27:35.3666667+00:00
Nandan Hegde 30,716 Reputation points MVP
3 answers

VS2017 - SSIS Project

Hello Team, We are using VS2017 with SSDT installed (PFB the screenshot) We cannot find BI projects, unable to create SSIS projects. Please advice. Regards, Nagesh CL

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Visual Studio
Visual Studio
A family of Microsoft suites of integrated development tools for building applications for Windows, the web and mobile devices.
4,814 questions
SQL Server Integration Services
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
2,502 questions
asked 2024-06-24T16:16:33.29+00:00
Nagesh CL 641 Reputation points
answered 2024-06-27T06:31:15+00:00
Praveen Kumar Tummalapati 0 Reputation points
1 answer One of the answers was accepted by the question author.

How to migrate data from Azure databases to the container of storage accounts?

hi friends, i want to migrate data from two databases of azure synapse analytics to my ADLS2 container.What is a simple and efficient way? Thanks

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-24T07:30:36.06+00:00
Huang, Winston-HR 300 Reputation points
commented 2024-06-27T04:10:20.5066667+00:00
Nandan Hegde 30,716 Reputation points MVP
1 answer One of the answers was accepted by the question author.

How may we change the default "Undeliverable..." subject and "wasn't found"-message auto-reply?

How may we change the default "Undeliverable..." subject and "wasn't found"-message auto-reply? "Undeliverable: [...]" and a default content message when opened reading "Your message to johndoe@thedomain.org couldn't…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,556 questions
Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
7,461 questions
Azure Content Delivery Network
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Azure App Service
Azure App Service
Azure App Service is a service used to create and deploy scalable, mission-critical web apps.
7,260 questions
asked 2024-06-26T18:10:40.74+00:00
chad oasiswm.org 20 Reputation points
accepted 2024-06-26T22:07:28.51+00:00
chad oasiswm.org 20 Reputation points
1 answer

pyspark merge dataframe issue

I am trying to merge multiple files using merge schema command in pyspark and i get the the following error. The pipeline runs every one hour. The merge schema works fine some times and it fails sometime. I am using the following command. df =…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-25T20:43:46.5233333+00:00
Admin (KK) 131 Reputation points
commented 2024-06-26T20:00:57.5133333+00:00
BhargavaGunnam-MSFT 28,526 Reputation points Microsoft Employee
4 answers

I can't do multiple unroll in flatten activity synapse dataflow

It was working quite well before, And started failing with "none.get" which is no where helping me to find the root cause, Even though I figured out that multiple flatten Unroll by cause the issue. My source is multiple Nested JSON try to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-06T16:34:28.0266667+00:00
Venkatesh S 5 Reputation points
commented 2024-06-26T19:15:52.9166667+00:00
Garrett Locke 25 Reputation points
2 answers One of the answers was accepted by the question author.

What causes javascript error 'Response is not defined' for Synapse Analytics deployment command validate, task 'Synapse workspace deployment@2'

Hi I would really appreciate some help with a build failure in ADO build pipeline. We haven't changed the underlying code base, and the node.js version is the same as the last successful build. This ADO build yaml snippet installs node.js and then…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-25T10:30:02.6133333+00:00
Jason Lee 21 Reputation points
accepted 2024-06-26T18:25:23.25+00:00
Jason Lee 21 Reputation points
1 answer

Granting the view permission for a stored procedure in a Synapse SQL pool

Hi, in a dedicated Synapse SQL pool is it to possible granting the view (and not the execution) permission for a stored procedure? Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-24T15:28:56.38+00:00
pmscorca 877 Reputation points
commented 2024-06-26T08:47:12.0666667+00:00
phemanth 7,835 Reputation points Microsoft Vendor
2 answers

Azure Data Bricks - User Doesn't have permission to perform this action while connecting to Azure Synapse Dedicate Pool

We are connecting Azure Synapse Analytics - Dedicated Pool using the PySpark Code that runs from Azure Data Bricks using SQL Authentication. While running, we are getting the below error when we use a user with db_datawriter and db_datareader…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
asked 2024-06-07T11:26:00.4933333+00:00
Praveen Sreeram 1 Reputation point
commented 2024-06-26T06:20:40.76+00:00
Praveen Kumar Sreeram 0 Reputation points
1 answer

Azure synapse link creates model.json with no partitions

Hi,   I am following this link below to copy dataverse data to Azure SQL DB using azure data factory pipelines. The model.json file created by my synapse link for dataverse is correctly creating the schema and attribute names for all the tables/entities.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Dynamics 365 Training
Dynamics 365 Training
Dynamics 365: A Microsoft cloud-based business platform that provides customer relationship management and enterprise resource planning solutions.Training: Instruction to develop new skills.
66 questions
asked 2024-06-25T19:12:57.98+00:00
Dipo Onibile 0 Reputation points
answered 2024-06-26T04:37:58.38+00:00
phemanth 7,835 Reputation points Microsoft Vendor
1 answer

Azure Synapse analytics with CosmosDB query is giving null values

Hi Team, we are storing data in Azure cosmos db for mongo and trying to query from Azure synapse serverless pool.when we query with Query items with full fidelity schema we are getting the values else we are getting string:value. can you please help us…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,514 questions
asked 2024-06-25T12:09:20.5533333+00:00
Sathya Sai Cheetirala 0 Reputation points
answered 2024-06-25T18:15:08.1333333+00:00
BhargavaGunnam-MSFT 28,526 Reputation points Microsoft Employee
1 answer

vm cpu utilization

Hi, have 100 VMs in Azure portal's resource group for which i am running VM memory metrix(cpu usage) .. how can it will automatically recognized the new subscription of vm came so that it will show the cpu usage via loading adf or databricks pipeline

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,994 questions
Azure App Service
Azure App Service
Azure App Service is a service used to create and deploy scalable, mission-critical web apps.
7,260 questions
asked 2024-06-20T10:33:21.4333333+00:00
Vineet S 265 Reputation points
commented 2024-06-25T17:29:58.2766667+00:00
Vineet S 265 Reputation points
1 answer One of the answers was accepted by the question author.

Spark job definition with blob fileName and folderPath is not working

I have a spark job definition in python file and passing the blob fileName and folderPath as parameters using Dynamic Content and Pipeline expression builder. I have defined the parameters as follow fileName default value to…

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,574 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-20T16:01:37.31+00:00
Johny Yagappan 20 Reputation points
accepted 2024-06-25T16:42:27.2133333+00:00
Johny Yagappan 20 Reputation points
1 answer One of the answers was accepted by the question author.

Spark 3.3 version upgrade getting fail with Error : Failure(java.lang.ClassNotFoundException: Failed to find data source: com.microsoft.sqlserver.jdbc.spark. Please find packages athttps://spark.apache.org/third-party-projects.html )

Dear Support-Team, As we aware Spark 3.2 version going to decommission from July 8, so, we are planning to upgrade our spark pools from 3.2 to 3.3 version. Fyi, we are maintaining metadata in Microsoft SQL Server. while using spark 3.2 version in azure…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-21T06:16:46.26+00:00
Akki, Siva Gopi 20 Reputation points
accepted 2024-06-25T16:37:25.26+00:00
Akki, Siva Gopi 20 Reputation points
0 answers

Azure Synapse Link for dataverse to bring Dynamics 365 data to ADLS and Synapse for analytical purpose - Facing Issues and inconsistencies in the feature

We are using Synapse Link for Dataverse feature to bring dynamics 365 data to ADLS and Synapse Analytics. We have below open issues due to which we are unable to finalize the solution: In F&O linked dataverse environment, we have created a synapse…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Dynamics 365 Training
Dynamics 365 Training
Dynamics 365: A Microsoft cloud-based business platform that provides customer relationship management and enterprise resource planning solutions.Training: Instruction to develop new skills.
66 questions
Microsoft Power Platform Training
Microsoft Power Platform Training
Microsoft Power Platform: An integrated set of Microsoft business intelligence services.Training: Instruction to develop new skills.
189 questions
Microsoft Dataverse Training
Microsoft Dataverse Training
Microsoft Dataverse: A Microsoft service that enables secure storage and management of data used by business apps. Previously known as Common Data Service.Training: Instruction to develop new skills.
14 questions
asked 2024-05-21T04:28:25.19+00:00
Sriram M 0 Reputation points
commented 2024-06-25T09:52:31.9433333+00:00
Harishga 5,510 Reputation points Microsoft Vendor
1 answer

PowerBI fails to connect to Azure Synapse works with SQL login

0 I am connecting to a synapse SQL database from powerBI, this is using a data gateway. If I use SQL authentication, it works fine however if i change it to OAuth authentication, I get the error below. Unable to create connection for the following…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-20T22:24:05.6066667+00:00
MrFlinstone 501 Reputation points
commented 2024-06-25T06:55:51.0733333+00:00
Harishga 5,510 Reputation points Microsoft Vendor
4 answers

unable to delete the Apache Spark pool in Azure Synapse Analytics

unable to delete the Apache Spark pool and attached error messages. I tried to delete via powershell as well from Azure Cloud Shell but no luck. As you can see in the screenshot there is no notebook1.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2023-02-08T18:28:02.17+00:00
Karthik R 5 Reputation points
commented 2024-06-24T20:56:11.3933333+00:00
Gaurav Khattar (MAQ LLC) 0 Reputation points Microsoft Vendor
1 answer

Reading sql pool auditing files (.xel)

I am trying to read audit files in Synapse analytics, made by automated auditing, using query select * from sys.fn_get_audit_file('https://datalake.dfs.core.windows.net/path/10_00_24_565_6.xel' ,DEFAULT ,DEFAULT ); But it just gives me empty…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-19T11:07:59.9366667+00:00
Jani Hämäläinen 40 Reputation points
commented 2024-06-24T19:47:23.3233333+00:00
BhargavaGunnam-MSFT 28,526 Reputation points Microsoft Employee
0 answers

Mssparkutils.credentials.getSecretWithLS to get Certificate and create CertificateCredential in Synapse

I need to create a CertificateCredential from azure.identity, I have a PKCS12 certificate saved in a Key Vault and I am reading it using mssparkutils with LinkedService, official documentation mentioned you can create a CertificateCredential with the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-09T18:24:19.5366667+00:00
BEPV 0 Reputation points
commented 2024-06-24T13:44:04.5766667+00:00
phemanth 7,835 Reputation points Microsoft Vendor
1 answer

Facing spark.kryoserializer.buffer.max overflow error in Azure Synapse Notebook. How to overcome this?

I am facing spark.kryoserializer.buffer.max overflow error in Synapse Notebook having transformation steps. My Notebook creates dataframes and Temporary Spark SQL Views and there are around 12 steps using JOINS. The number of records being transformed…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-24T09:41:03.9166667+00:00
Dravya Jain 0 Reputation points
answered 2024-06-24T11:06:07.3433333+00:00
Harishga 5,510 Reputation points Microsoft Vendor