Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
1 answer
Encryption Data on transit - from oracle to Azure Data lake
Hello - We have this implementation setup: use Synapse analytics Pipelines to extract data from Oracle OCI database Copy data to Azure data Lake Storage Transform data from ADLS Gen 2 to Azure Sql Database We want to make sure that : Data…
asked 2024-07-02T07:19:25.15+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 88%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EXM%3C/text%3E%3C/svg%3E)
Xhevahir Mehalla
160
Reputation points
answered 2024-07-02T08:04:46.35+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 57.99999999999999%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERH%3C/text%3E%3C/svg%3E)
Ramya Harinarthini_MSFT
5,311
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
App could not could not connect to Azure Synapse when created via ARM template - SSL connection could not be established
Hello. I need your help with smth that we find a difficult to resolve. Here's the current setup: I have created an Azure Synapse workspace using ARM templates. All is working well apart from when an App which has been build on Angular could not connect…
asked 2024-06-21T07:56:17.4333333+00:00
Xhevahir Mehalla
160
Reputation points
commented 2024-07-02T07:45:18.94+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,090
Reputation points Microsoft Vendor
1 answer
Servicenow linked service used connectivity vendor
I am interested in using Servicenow Linked Service to extract data from Servicenow. There are two linked services available; the legacy version and version 2 that uses table API. The documentation mentions a built-in driver for enabling connectivity. Can…
asked 2024-06-27T10:50:37.5233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 99%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAB%3C/text%3E%3C/svg%3E)
Amir Bagheripour
0
Reputation points
edited a comment 2024-07-02T07:01:45.6866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 48%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Harishga
5,510
Reputation points Microsoft Vendor
1 answer
unable connect Azure Synapse database
Hi, while creating link services for connecting azure synapse database..i am getting error that Insufficient permissions to call this API. 1829be47-97cd-4a80-b8f7-9402f8fbcc20 does not have Microsoft.Synapse/workspaces/credentials/useSecret/action on…
asked 2024-07-01T19:38:25.9533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 13%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
Vineet S
265
Reputation points
answered 2024-07-02T02:50:19.71+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
0 answers
how to generate token in synapse notebook using identity
how to generate token in synapse notebook using identity. Why below code is not working? import requests def get_token_for_risk_api(): resource = "https://xxxxxx" user_managed_client_id = "xxxx" api_version =…
asked 2024-06-24T07:59:14.77+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 59%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENK%3C/text%3E%3C/svg%3E)
Nitin Khedekar (WIPRO LIMITED)
0
Reputation points Microsoft Vendor
commented 2024-07-01T13:30:19.0266667+00:00
Smaran Thoomu
12,090
Reputation points Microsoft Vendor
1 answer
Notification email fail/not started pipeline Synapse
I would like to set up a notification (email) for a pipeline in Synapse to be sent if it fails or if it does not start. How do I do this? I have already created an Azure alert, but it only triggers if the pipeline encounters an error, not if it does not…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 70%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
1 answer
Synapse how to read excel with formula
Hello, in Synapse spark pool we need to read excel file that contains formula inside of cells (sometimes it is simple sum, sometimes complicated formula, sometimes it is reference to another spread sheet and cell). Unfortunately, we observe that some…
asked 2024-06-27T08:57:56.29+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 64%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETT%3C/text%3E%3C/svg%3E)
Tamashevich, Tatsiana
40
Reputation points
commented 2024-07-01T06:28:16.75+00:00
Harishga
5,510
Reputation points Microsoft Vendor
1 answer
Unable to run an SQL query in Azure Synapse
Hi, I am unbale to run a simple sql query. It keeps throwing this following error. File 'https://storagecontainer/Financial Sample.xlsx' cannot be opened because it does not exist or it is used by another process. I assigned myself with Storage Blob Data…
asked 2024-06-30T14:25:48.4233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 17%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESA%3C/text%3E%3C/svg%3E)
shailaja Azure
0
Reputation points
answered 2024-07-01T05:46:47.4933333+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
0 answers
Custom logging in Azure Synapse Datapipeline to to log analytics Workspace - Help Requested
Requirement:- Want to add custom logging in azure synapse pyspark job using python logging module and spark config Getting error while implementing the same in the pyspark job ModuleNotFoundError: No module named 'pyspark.SparkConf pyspark script for…
asked 2024-06-26T23:18:27.1633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 21%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJY%3C/text%3E%3C/svg%3E)
Johny Yagappan
20
Reputation points
commented 2024-07-01T05:26:24.7633333+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
1 answer
Unable to connect On-Premises SQL DB through Spark Notebook in Synapse workspace
HI Team, We are unable to connect On-Premises SQL DB through Spark Notebook in Synapse workspace. We have been trying to connect with private endpoints from Synapse workspace to SQL DB as we have instructions not to use public networks. Followed below…
asked 2024-06-24T17:18:53.74+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 71%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Sai Kishore Amara
20
Reputation points
commented 2024-07-01T05:19:18.0366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
7,835
Reputation points Microsoft Vendor
2 answers
Issue with Copy Dataverse data into Azure SQL using Synapse Link Template
I am experiencing issues using ADF I am trying to use the template "Copy Dataverse data into Azure SQL using Synapse Link" to move f&o data from datalake to Azure…
asked 2024-05-30T07:08:10.6766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 20%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDO%3C/text%3E%3C/svg%3E)
Dipo Onibile
0
Reputation points
commented 2024-07-01T04:55:32.2433333+00:00
phemanth
7,835
Reputation points Microsoft Vendor
1 answer
Is Synapse Serverless Down?
As of ~12:53 CET all of our queries on Synapse Serverless have been timing out with the message: [This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry…
asked 2024-06-27T12:05:26.4133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 17%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Mark Mellink
35
Reputation points
commented 2024-06-30T16:34:29.03+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
28,526
Reputation points Microsoft Employee
1 answer
How to install com.crealytics.spark.excel to Synapse Spark Pool
Hello, I have spark pool with following properties: According to the instruction mentioned under the Q&A https://video2.skills-academy.com/en-us/answers/questions/1185314/how-to-write-data-from-notebook-to-dedicated-sql-p?cid=kerryherger I have…
asked 2024-06-26T14:34:57.57+00:00
Tamashevich, Tatsiana
40
Reputation points
commented 2024-06-30T14:26:33.5733333+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
1 answer
Do Apache Spark Pools have a Service Tag?
Our company is rolling out more restrictive network security groups and I wanted to see if we could have our Apache Spark Pools' traffic be allowed via a service tag. When I tried to trace the IP address of the pools, the IPs varied widely so a static IP…
asked 2024-06-28T15:07:17.05+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 95%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAC%3C/text%3E%3C/svg%3E)
Andrew Chung
20
Reputation points Microsoft Employee
answered 2024-06-30T11:06:00+00:00
PRADEEPCHEEKATLA-MSFT
84,051
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Issue with running queries on Synapse SQL Endpoint - This query cannot be executed because we can't get enough capacity for optimal performance in time.
Dear Community, I am getting the error ""This query cannot be executed because we can't get enough capacity for optimal performance in time."" when running a query using a SQL Serverless endpoint in Synapse Analytics This error…
1 answer
Unable to run query on Synapse Serverless SQL Pool suddenly
I have a few of external table in an Azure Synapse Analytics Serverless SQL Pool which I need to query frequently. I suddenly got this error today. [This query cannot be executed because we can't get enough capacity for optimal performance in time. This…
asked 2024-06-27T06:30:27.38+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 12%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKW%3C/text%3E%3C/svg%3E)
Kenny Wong (HK)
40
Reputation points
answered 2024-06-28T21:12:33.17+00:00
BhargavaGunnam-MSFT
28,526
Reputation points Microsoft Employee
1 answer
Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.
Strangely since morning Synapse SQL Serverless on one environment is not able to query external data in a storage account. This was running fine till now [This query cannot be executed because we can't get enough capacity for optimal performance in time.…
asked 2024-06-28T13:39:30.8133333+00:00
amit karmakar
0
Reputation points
answered 2024-06-28T21:10:21.5133333+00:00
BhargavaGunnam-MSFT
28,526
Reputation points Microsoft Employee
1 answer
Import filenames from Azure Storage container to SQL Table using Azure Data Factory
Hi All, I am trying to import filenames from an Azure Storage container into a table in a Dedicated SQL Pool (formerly SQL DW) using Azure Data Factory. For example, I have around 2,000 JSON files in an Azure Storage container, and I would like to…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 74%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 64%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENR%3C/text%3E%3C/svg%3E)
1 answer
High availability of Synapse dedicated SQL pool within a region
We have provisioned a Synapse dedicated SQL pool for our business. We need to make sure that the service is highly available within the region. This means we cannot have the data be moved to another region but need to make sure that the DWH is available…
asked 2024-06-26T03:42:13.2066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 11%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECA%3C/text%3E%3C/svg%3E)
Chand, Anupam SBOBNG-ITA/RX
461
Reputation points
edited a comment 2024-06-28T04:49:08.3866667+00:00
Harishga
5,510
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
JIRA Tempo REST API with Copy Data Activity connection issue
Dear all, I would like to store the data from JIRA Tempo Account into my Azure Storage Account via Copy Data activity in Azure Synapse Workspace. It would be great if someone could help me on this. I create a new linked service with REST API and put…
asked 2024-06-25T10:28:48.1633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 75%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZM%3C/text%3E%3C/svg%3E)
Zhuoqiong Mo
40
Reputation points
accepted 2024-06-27T08:55:14.2233333+00:00
Zhuoqiong Mo
40
Reputation points