4,621 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Transport Level-Error | Synapse,SQL

Hi , Please could you help me with the following error: Msg 10054, Level 20, State 0, Line 0 A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 0 - An existing connection was forcibly…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,203 questions
asked 2020-09-08T11:21:34.06+00:00
demo case 1 Reputation point
commented 2020-09-14T16:08:06.717+00:00
HimanshuSinha-msft 19,376 Reputation points Microsoft Employee
1 answer

Not able to delete any resource

Please help me regarding this error. Not able to delete resource group.

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,045 questions
asked 2020-09-10T09:57:36.12+00:00
demo case 1 Reputation point
commented 2020-09-14T07:51:40.453+00:00
HarithaMaddi-MSFT 10,136 Reputation points
1 answer

Security Recommendations for Azure Data and Analytics Services

I am working on Securing Data and Analytics Services on Azure. I want to know what security controls i can apply after creating of services and what i can apply only during the service creation. Below are the recommendation i have found as of now. Could…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
Azure HDInsight
Azure HDInsight
An Azure managed cluster service for open-source analytics.
204 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,045 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,015 questions
asked 2020-09-02T20:20:43.98+00:00
Akash Verma 21 Reputation points
commented 2020-09-09T11:11:32.767+00:00
PRADEEPCHEEKATLA-MSFT 84,381 Reputation points Microsoft Employee
1 answer

Synapse Analytics - Cluster does not use requirements.txt file

I've been trying to include some additional Python packages in a Spark cluster, but when I put my requirements.txt file up (using any of the three methods here) and restart the cluster, the packages are not available (either when I try to import…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-27T11:21:21.78+00:00
Rory Tarnow-Mordi 1 Reputation point
commented 2020-09-08T18:00:11.757+00:00
HimanshuSinha-msft 19,376 Reputation points Microsoft Employee
0 answers

Identifying the columns in temp table in synapse

Hello All, How can we get the list of all columns present in a temp table in Synapse? IF OBJECT_ID(N'tempdb..#LocalCustomer') IS NOT NULL BEGIN Drop table #LocalCustomer Go CREATE TABLE ajs.#LocalCustomer ( CustomerId int, CustomerName…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-09-02T07:21:13.557+00:00
Nandan Hegde 30,716 Reputation points MVP
commented 2020-09-08T15:10:29.87+00:00
HarithaMaddi-MSFT 10,136 Reputation points
1 answer

Is it possible to lock down the # of executors?

We want to be able to lock our spark/sql resources down so that the business doesn't rack up the bill. Is this possible to do?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-09-02T17:55:44.83+00:00
Ian Santillan 197 Reputation points
answered 2020-09-03T16:13:37.23+00:00
Euan Garden 136 Reputation points
1 answer

Synapse Azure Preview - ServerName

Hi, I am trying to pause SQL pool in Synapse (Preview version) via PowerShell command and Automation. I've found this: Suspend-AzureRmSqlDatabase –ResourceGroupName "myResourceGroup" –ServerName "nsqlpoolservername"…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-27T05:33:32.277+00:00
Martina Novakova 1 Reputation point
commented 2020-09-03T04:43:55.337+00:00
HarithaMaddi-MSFT 10,136 Reputation points
0 answers

How to copy data from Azure SQL Database to Azure Synapse?

Hello Experts, I am pretty new to Azure Data Factory and struggling with a simple problem. I've done this in SSIS but now trying to implement the same in Azure Data Factory. I have a list of tables that I would like to copy the data on an incremental…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,015 questions
asked 2020-08-30T16:39:04.32+00:00
Julaayi 1 Reputation point
commented 2020-09-03T04:43:02.267+00:00
HarithaMaddi-MSFT 10,136 Reputation points
1 answer

Azure SQL Data Warehouse distribution

Hi, I am working on Azure SQL Data Warehouse(Synapse) in it there is a fact table with nearly 10 billion rows spread across 40 columns. It is a 100DWU server. When I try to fetch records from this table it takes more then 30 mins to pull 9 million rows…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-31T10:25:08.49+00:00
SQLGeek 1 Reputation point
commented 2020-09-02T12:40:54.793+00:00
SQLGeek 1 Reputation point
1 answer One of the answers was accepted by the question author.

Unable to load data into Azure Synapse from ADLS Gen 2 .csv file

Hi @ChiragMishraMSFT-1092 Upon trying to load the data from ADLS(csv files) into Azure DW, am encountering a error in loading the data in DW. Here is the error message: "message": "Failure happened on 'Sink' side.…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-27T07:24:45.763+00:00
RahulK 101 Reputation points
accepted 2020-08-30T07:11:59.337+00:00
RahulK 101 Reputation points
1 answer

Monitoring > Apache Spark applications, not seeing any successes

I'm not seeing any success messages even though my notebooks runs with no issues. Any ideas why?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-24T16:03:34.837+00:00
Ian Santillan 197 Reputation points
answered 2020-08-28T16:54:22.057+00:00
Ian Santillan 197 Reputation points
4 answers One of the answers was accepted by the question author.

Identity Column in Synapse

Hello, In Synpase , an identity column is not an auto incremental column similar to normal SQL database identity columns. It provides a unique integer value but not an incremented one like (if previous value is 10 then next value should be 11, it…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-21T06:13:14.877+00:00
Nandan Hegde 30,716 Reputation points MVP
commented 2020-08-28T04:26:17.28+00:00
Ronen Ariely 15,101 Reputation points
1 answer One of the answers was accepted by the question author.

Unable to connect to Azure SQL DW & DB via SSMS, SSDT - error 10060

Hi, I'm trying to connect to Azure SQL Data Warehouse via SSMS and SSDT from my local with SQL Authentication and AD universal MFA, but I'm unable to and getting error number 10060 (Connected host failed to respond ). I've added my client IP to…

Azure SQL Database
Azure Firewall
Azure Firewall
An Azure network security service that is used to protect Azure Virtual Network resources.
600 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,203 questions
asked 2020-08-05T16:25:52.757+00:00
Neil Pereira 81 Reputation points
accepted 2020-08-26T16:15:13.157+00:00
Neil Pereira 81 Reputation points
1 answer

Synapse spark-avro module is external and not included in spark-submit

Hi. I have processing avro files from data lake store gen2 using databricks and it worked fine. Now I am testing the same scenario usinf spark pool of Synapse Analytics. but spark-avro module is external and not included in spark-submit. How can I…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-19T13:34:26.577+00:00
Robson Soares 1 Reputation point
commented 2020-08-25T09:42:04.213+00:00
PRADEEPCHEEKATLA-MSFT 84,381 Reputation points Microsoft Employee
1 answer

Querying partitioned data with SQL on-demand?

It is common to partition data within data lakes and this is reflected in the form of a folder hierarchy. What is the proper way to query partitioned data with SQL on-demand within Azure Synapse Analytics, as according to my understanding e.g.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-18T11:25:07.39+00:00
Veli-Jussi Raitila 381 Reputation points
commented 2020-08-24T19:56:10.89+00:00
MartinJaffer-MSFT 26,051 Reputation points
1 answer One of the answers was accepted by the question author.

Azure Synapse Analytics, change database owner

Any one know how to change the database owner on a azure synapse sql database to follow best practice to set owner as a disabled logon. Successfully updated azure sql using the command below but does work on a synapse datase on the same azure sql…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-19T23:40:19.003+00:00
Darren Price 21 Reputation points
accepted 2020-08-21T15:54:47.76+00:00
Darren Price 21 Reputation points
0 answers

Generic Error in Synapse Studio Pipeline

Hello, I am just starting to use Synapse Studio. However, I have been using Azure Data Factory for a few months. I have a pipeline that is just a single dataflow activity, copying data from our Azure SQL to Synapse SQL Pool. But I keep getting this…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,015 questions
asked 2020-08-17T23:23:01.177+00:00
Jaryd 177 Reputation points
commented 2020-08-21T15:33:04.217+00:00
HarithaMaddi-MSFT 10,136 Reputation points
2 answers

Real time Data warehouse with Azure Synapse

Hi, I'm working on data warehouse POC for Azure and one of the key questions that I'm working on right now is the solution option where data can be refreshed (every hour, 4 hour or near real-time). Also, need to get an approximate idea of how the cost…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-10T23:44:15.33+00:00
BIFlake 1 Reputation point
commented 2020-08-19T06:08:05.49+00:00
HarithaMaddi-MSFT 10,136 Reputation points
2 answers One of the answers was accepted by the question author.

SQL build fails in azure dev ops pipelines when selecting Microsoft Azure SQL Data Warehouse as the target platform in Visual Studio

SQL build fails in azure dev ops pipelines when selecting Microsoft Azure SQL Data Warehouse as the target platform in Visual Studio 2019 It succeeds when i change the target platform to Microsoft Azure SQL database, but fails when i change it to SQL…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
Visual Studio
Visual Studio
A family of Microsoft suites of integrated development tools for building applications for Windows, the web and mobile devices.
4,821 questions
Not Monitored
Not Monitored
Tag not monitored by Microsoft.
37,378 questions
asked 2020-08-13T12:18:05.987+00:00
Albert Dove 21 Reputation points
accepted 2020-08-17T06:19:53.777+00:00
Albert Dove 21 Reputation points
2 answers

Cannot access Azure Synapse DWH on portal, "The resource was not found" error

When I access synapse Datawarehouse on a portal the resource not found error happening. But I am still using data explorer and data factory to connect to this DWH The detailed error as below: Details The resource was not found, it may have been…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
asked 2020-08-07T06:03:18.033+00:00
HUYNH DUY HAI DU 1 Reputation point
commented 2020-08-15T12:52:18.487+00:00
HarithaMaddi-MSFT 10,136 Reputation points