4,614 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Error while creating linked service from Synapse to Dyanamics 365

I am trying to create Linked Service from Microsoft Synapse to Dynamics 365. While testing connect I am getting error ClientIpAddressNotAuthorized. We have licensed Microsft Synapse and trial version of Dynamics 365.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-07-03T06:15:50.9666667+00:00
Rakesh Gupta 0 Reputation points
commented 2024-07-03T09:45:00.6266667+00:00
PRADEEPCHEEKATLA-MSFT 84,051 Reputation points Microsoft Employee
0 answers

synapse notebook

Hi , how we can add link services created in synapse in notebook available azure synapse link servicename :test2 select * from test1.table1

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-07-03T09:23:09.2166667+00:00
Vineet S 265 Reputation points
edited the question 2024-07-03T09:37:53.62+00:00
Vineet S 265 Reputation points
2 answers

CopyData in ForEach

Dear all, I want to use the copydata activity in my pipeline. I have a csv file in my storage account, which has the list of the data i want to pass into the copy activity. I create a lookup activity first and then I try to use ForEach and put the copy…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,994 questions
asked 2024-06-27T09:48:48.74+00:00
Zhuoqiong Mo 40 Reputation points
edited a comment 2024-07-03T09:19:41.35+00:00
phemanth 7,835 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

How to send data into displayHTML function in Azure Synapse Analytics

Hi, As mentioned in this link https://video2.skills-academy.com/en-us/azure/synapse-analytics/spark/apache-spark-data-visualization I want to use D3.js to visualize my data. How do I send data from my pyspark dataframe into displayHTML() to visualize it?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-28T06:28:54.47+00:00
Raghul Kannan 146 Reputation points
accepted 2024-07-03T08:40:26.0066667+00:00
Raghul Kannan 146 Reputation points
0 answers

azure synapse

hey i try to get sdk call that return me the info about the Azure Active Directory i cant find the sdk call for this

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-26T08:13:52.66+00:00
Tommy Mordehay 0 Reputation points
commented 2024-07-03T08:29:53.3366667+00:00
PRADEEPCHEEKATLA-MSFT 84,051 Reputation points Microsoft Employee
1 answer

ALTER TABLE ADD COLUMN changes made to Synapse Delta tables in a Notebook do not reflect in Lake Database

Running the following spark.sql("ALTER TABLE example_table ADD COLUMN example_column STRING") Successfully adds the column to the Delta table and this can be verified by running %%sql SELECT example_column FROM example_table However when…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-30T20:51:36.6366667+00:00
Francesca Lightbown 0 Reputation points
commented 2024-07-03T08:09:55.2433333+00:00
Smaran Thoomu 12,090 Reputation points Microsoft Vendor
1 answer

How can I enable Synapse Link on a source azure serverless sql db to connect to dedicated sql pool..

Context Our team is planning to regularly refresh our external valuations dedicated pool using staging data from our serverless sql database. To implement this I have created the dedicated sql pool and the azure sql db is ready with plenty of data. The…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-07-01T06:11:32.8433333+00:00
Michael Minto 25 Reputation points
edited a comment 2024-07-03T06:09:33.88+00:00
Harishga 5,510 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

CDM and synapse datawarehouse

Hi friends, I have some questions on CDM common data model and what use cases it best suited for ? Since CDM has attributes , entities and relationships does it fair to assume that we don't need to do data model such as star schema and snowflake schema?…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,994 questions
asked 2024-07-02T18:13:42.5333333+00:00
Anshal 2,006 Reputation points
accepted 2024-07-03T04:55:11.18+00:00
Anshal 2,006 Reputation points
1 answer

Unable to use Synapse workspace features in Synapse Link for Dataverse when Synapse network is in private mode

Hi Team, We are using Synapse Link for Dataverse for syncing data from d365 to ADLS Gen2, which can be used for analytics in ADLS Gen2. As our Synapse analytics environment network is publically disabled and using…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Dynamics 365 Training
Dynamics 365 Training
Dynamics 365: A Microsoft cloud-based business platform that provides customer relationship management and enterprise resource planning solutions.Training: Instruction to develop new skills.
66 questions
Microsoft Power Platform Training
Microsoft Power Platform Training
Microsoft Power Platform: An integrated set of Microsoft business intelligence services.Training: Instruction to develop new skills.
189 questions
Microsoft Dataverse Training
Microsoft Dataverse Training
Microsoft Dataverse: A Microsoft service that enables secure storage and management of data used by business apps. Previously known as Common Data Service.Training: Instruction to develop new skills.
14 questions
asked 2024-06-25T06:40:07.63+00:00
Sriram M 0 Reputation points
edited the question 2024-07-03T00:57:23.3633333+00:00
Sriram M 0 Reputation points
1 answer

how to fix an issue where records are not syncing from Dataverse to Azure Database intermittently?

Successfully generated a summary I am experiencing an issue where records are not syncing from Dataverse to Azure Database intermittently, specifically for the Payment (evx_payment) entity. The affected records only sync when the customer manually…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Microsoft Dataverse Training
Microsoft Dataverse Training
Microsoft Dataverse: A Microsoft service that enables secure storage and management of data used by business apps. Previously known as Common Data Service.Training: Instruction to develop new skills.
14 questions
asked 2024-07-02T21:16:35.34+00:00
Gustavo Mercado (LTIMINDTREE LIMITED) 20 Reputation points Microsoft Vendor
answered 2024-07-02T23:33:25.1+00:00
Gustavo Mercado (LTIMINDTREE LIMITED) 20 Reputation points Microsoft Vendor
0 answers

Guidance on how to use Service Principal with Certificate to Authorize for EventHub Stream Read

I found this documentation https://github.com/Azure/azure-event-hubs-spark/blob/master/docs/use-aad-authentication-to-connect-eventhubs.md online on how to use service principal with certificate to use spark stream read from EventHubs, I want to do this…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
586 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
Microsoft Entra ID
Microsoft Entra ID
A Microsoft Entra identity service that provides identity management and access control capabilities. Replaces Azure Active Directory.
20,317 questions
asked 2024-07-01T21:27:20.97+00:00
BEPV 0 Reputation points
edited a comment 2024-07-02T20:49:46.0566667+00:00
Sina Salam 6,501 Reputation points
2 answers

unable to connect synapse db

Hi, Cannot connect to SQL Database. Please contact SQL server team for further support. Server: 'tcp:ag-syn-bi-group-d.sql.azuresynapse.net,1433', Database: 'bronze', User: ''. Check the linked service configuration is correct, and make sure the SQL…

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,864 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,994 questions
asked 2024-07-02T14:07:35.56+00:00
Vineet S 265 Reputation points
commented 2024-07-02T20:48:02.03+00:00
Vineet S 265 Reputation points
0 answers

Azure Synaps serverless scan file that should be filtered

Hey, We have a large amount of files stored in Storage Account in Parquet format with the following hierarchy. /m_id=%M_ID%/quarter=%QUARTER%/month=%MONTH%/partition_version=last/part-0.parquet'. examples for quarter values: 2024Q1, 2024Q2, 2024Q3…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-07-01T08:48:06.6533333+00:00
Shlomi Lanton 56 Reputation points
commented 2024-07-02T20:08:35.5666667+00:00
Shlomi Lanton 56 Reputation points
1 answer One of the answers was accepted by the question author.

Install Packages on Azure Synapse DEP-enabled workspaces

Hi I have a Synapse workspace with DEP enabled. Since PyPI libraries cannot be installed directly in the Spark pool, could you please advise on how to install the azure-mgmt-kusto, azure-kusto-data, and azure-keyvault-secrets packages on the pool? I…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-26T02:17:08.77+00:00
Abhiram Duvvuru 211 Reputation points Microsoft Employee
accepted 2024-07-02T18:40:49.32+00:00
Abhiram Duvvuru 211 Reputation points Microsoft Employee
1 answer

Azure synapse and reserved pricing discount

From looking at the link here https://azureaggregator.wordpress.com/2021/02/09/data-flows-in-adf-and-synapse-now-support-reserved-instance-pricing/ and …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-07-02T14:58:46.54+00:00
MrFlinstone 501 Reputation points
answered 2024-07-02T16:37:27.8733333+00:00
ShaikMaheer-MSFT 38,321 Reputation points Microsoft Employee
0 answers

SynapseML OpenAIChatCompletion lacks image support

OpenAIs GPT4-o model allows for an "image_url" as argument type in its Chat Completions API, but the corresponding SynapseML function seems to lack this option according to the documentation OPENAI chat completions API: response =…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,529 questions
asked 2024-07-02T07:26:20.9166667+00:00
Hiob Gebisso 101 Reputation points
commented 2024-07-02T16:08:49.04+00:00
BhargavaGunnam-MSFT 28,526 Reputation points Microsoft Employee
0 answers

After some time, viewing pipeline log links lead to wrong page

This is something I consistently experience if I use the same Synapse Analytics Workspace for a decent amount of time: My workflow is: Monitor Pipeline Runs Click on a run of interest This shows me the pipeline that ran and all the individual steps…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-06-27T14:13:06.36+00:00
Andrew Chung 20 Reputation points Microsoft Employee
commented 2024-07-02T15:52:01.42+00:00
phemanth 7,835 Reputation points Microsoft Vendor
1 answer

How to Handle Errors and Row Counts in Synapse Stored Procedures

I'm migrating a stored procedure from a Data Warehouse to Azure Synapse Dedicated SQL pool. The procedure uses @@error and @@rowcount variables, which are not supported in Synapse. Are there alternative ways to achieve the same functionality without…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-07-02T13:05:32.38+00:00
vikranth-0706 180 Reputation points
answered 2024-07-02T13:57:37.4833333+00:00
Nandan Hegde 30,716 Reputation points MVP
1 answer

Unable to connect Fivetran with public IP to ADLS Gen2 in Vnet with Private end point

Hi, I'm encountering an issue while trying to connect Fivetran to ADLS Gen2 in the UK South region. Here are the details: I have configured ADLS Gen2 as a destination in Fivetran and completed the prerequisites, including creating an SPN with appropriate…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,864 questions
Azure Virtual Network
Azure Virtual Network
An Azure networking service that is used to provision private networks and optionally to connect to on-premises datacenters.
2,257 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
Azure Network Watcher
Azure Network Watcher
An Azure service that is used to monitor, diagnose, and gain insights into network performance and health.
161 questions
asked 2024-07-01T13:39:20.48+00:00
Sriram M 0 Reputation points
answered 2024-07-02T11:04:53.1833333+00:00
Nehruji R 4,126 Reputation points Microsoft Vendor
1 answer

Microsoft fabric

I don't have an organization email ID. I am unable to create Microsoft fabric service and login using personal email ID. I have also created a new email ID on Microsoft365, but I am still unable to create Microsoft fabric service and login. How do I fix…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,614 questions
asked 2024-07-02T09:23:39.9966667+00:00
Raaj 0 Reputation points
answered 2024-07-02T10:30:32.2833333+00:00
PRADEEPCHEEKATLA-MSFT 84,051 Reputation points Microsoft Employee