Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,787 questions
2 answers
One of the answers was accepted by the question author.
Getting Socket error code timed out while connecting to a SFTP server via Azure data factory
I am very new to Azure and My Use Case is that, I want to move the file from my Azure blob storage to a third party SFTP server. I got to know that Azure data factory will help me to move the files out by creating linked services from source and target…
Azure Blob Storage
Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,161 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,568 questions
asked 2024-09-04T04:18:44.96+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 35%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERV%3C/text%3E%3C/svg%3E)
Ridhima Verma
25
Reputation points
commented 2024-09-05T05:50:27.85+00:00
Vinodh247
18,251
Reputation points
0 answers
New ADF Connector for Salesforce doesn't allow for aggregate queries
Hi, We are trying to update from our legacy Salesforce connector in ADF to the new one which is mostly working to retrieve data but we cannot do a count of rows in a table with the new connector. Bulk API doesn’t support queries with any of the…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 47%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
1 answer
ADF - ETL Improve Performance
Hi, I have implemented SCD type 4 for loading our source files into Azure SQL. We have about 3 years of files(7000+ files), We need to load all these files into Azure SQL. We need to preserve the history of data. Live/Latest data will be in Target table,…
asked 2024-08-28T08:57:51.8133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 54%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
Santhi Dhanuskodi
265
Reputation points
commented 2024-09-05T03:30:04.1066667+00:00
AnnuKumari-MSFT
32,816
Reputation points Microsoft Employee
1 answer
data type issue in adf pipeline
Hi Team, when i use adf pipeline from salesforce as source and azure storage as sink, one table not loading and getting error like below Failure happened on 'Source' side.…
asked 2024-08-19T10:35:00.0266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 64%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERB%3C/text%3E%3C/svg%3E)
Ram Babu
75
Reputation points
edited the question 2024-09-04T22:15:20.51+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 98%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KarishmaTiwari-MSFT
19,872
Reputation points Microsoft Employee
1 answer
In the context of optimizing data workflows using Microsoft Power BI, how would you leverage the DAX (Data Analysis Expressions) language to enhance performance for complex aggregations and calculations in large datasets?
In the context of optimizing data workflows using Microsoft Power BI, how would you leverage the DAX (Data Analysis Expressions) language to enhance performance for complex aggregations and calculations in large datasets? Discuss the techniques for…
asked 2024-08-17T09:37:01.03+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 88%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMH%3C/text%3E%3C/svg%3E)
MUHAMMAD HAFIZULLAH BIN MOHD ROSLAN Moe
0
Reputation points
edited the question 2024-09-04T22:11:09.5533333+00:00
KarishmaTiwari-MSFT
19,872
Reputation points Microsoft Employee
4 answers
Comparing File dates and times in ADF
I am using the following expression in an 'If condition' activity: @greater(formatDateTime(activity('Get Target File Metadata').output.lastModified, 'yyyy-MM-dd HH:mm:ss'), formatDateTime(variables('PreviousModifiedDate'),'yyyy-MM-dd HH:mm:ss') 'Get…
asked 2024-09-04T18:07:40.2133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 19%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPD%3C/text%3E%3C/svg%3E)
Pendleton, David
20
Reputation points
answered 2024-09-04T20:55:27.8533333+00:00
Pendleton, David
20
Reputation points
0 answers
Json in synapses
Hi, how to run json file on synapse workspace.. Tried with data flow but not reading files after data using flattens transformation... Trying convert in parquet..Pls share screenshot(file attached). have selected …
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 13%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
1 answer
Data flow expression builder syntax error with parameters
I have a dataflow that works fine when values are static. However if I try to use Parameters, I get the following error Spark job failed: { "text/plain":…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 6%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKS%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
How does Access Tier affect the Get Metadata Activity?
How does the Access Tier of an object affect the Get Metadata Activity? If an object is Cold or Archived for example, will the Get Metadata Activity have to wait for the object to be retrieved?
asked 2024-08-28T20:21:09.99+00:00
Pendleton, David
20
Reputation points
accepted 2024-09-04T14:56:33.7233333+00:00
Pendleton, David
20
Reputation points
1 answer
Azure Connection Issue: "Input Payload in invalid"
Hi, All our existing connections (linked services) to Azure services, such as database, blob storage, SFTP etc. have suddenly stopped functioning. These connections were operating without any issues this morning, but they have suddenly caused the…
asked 2024-08-29T23:30:21.3266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 82%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAW%3C/text%3E%3C/svg%3E)
Angus White
0
Reputation points
commented 2024-09-04T14:49:48.6733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
10,240
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
logging and monitoring mechanism
I need to come up with a sound strategy and develop a robust logging and monitoring plan that captures and gives critical information on all the key metrics such as availability, performance, bottlenecks, etc. around all the Azure services such as ADF…
asked 2024-08-31T10:33:51.5133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 88%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
azure_learner
220
Reputation points
accepted 2024-09-04T13:36:32.1566667+00:00
azure_learner
220
Reputation points
3 answers
One of the answers was accepted by the question author.
Global Paramaters in Fabric Data Factory
Hi Is there any plan to introduce Global Parameters in Fabric's Data Factory , we have this in Azure Data Factory so just asking if there is plan to introduce this in Fabric's Data Factory.
asked 2023-08-17T05:41:03.0933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(105.60000000000001, 54%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJK%3C/text%3E%3C/svg%3E)
Jotheesh Kumar
20
Reputation points
edited an answer 2024-09-04T11:54:58.05+00:00
Fredrik Juel Hagen
0
Reputation points
1 answer
Business Central Connector for Azure Data Factory
Is there a connector that can be configured to allow data to be extracted from Business Central into Azure Data Factory? Please do not confuse my query for AX or Finance and Operations.
asked 2024-08-08T22:04:24.4033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(41.6, 18%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAH%3C/text%3E%3C/svg%3E)
Andrew Hairston Cloud
0
Reputation points
commented 2024-09-04T11:51:49.4733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 4%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAB%3C/text%3E%3C/svg%3E)
Apoorva Belsare
0
Reputation points
2 answers
One of the answers was accepted by the question author.
Unauthorzied 401 while accessing sharepoint
Good day! I followed the official docs to establish a connection between ADF and Sharepoint: https://video2.skills-academy.com/en-us/azure/data-factory/connector-sharepoint-online-list?tabs=data-factory Though, when I execute a pipeline I encounter an error:…
asked 2024-09-02T13:02:34.33+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 57.00000000000001%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJW%3C/text%3E%3C/svg%3E)
Jan Wojciechowski
20
Reputation points
accepted 2024-09-04T09:05:09.1+00:00
Jan Wojciechowski
20
Reputation points
1 answer
One of the answers was accepted by the question author.
Git Repository last published commit is blank after Editing
I edited the Git Repository in Data Factory to see the options available and saved it (bad idea). As a result, the Git Repository last published commit value is now blank. Now, when I go to publish in Data Factory it wants to publish all the resources…
asked 2024-08-20T01:00:34.5966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 61%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EML%3C/text%3E%3C/svg%3E)
Mark Leonard
25
Reputation points
accepted 2024-09-04T05:42:10.63+00:00
Mark Leonard
25
Reputation points
1 answer
Secure Data connection from Data Factory.
Hi, We are using Data factory service in Azure and created "Selfhosted Integration Runtime" on the window virtual machine in azure for connecting on-premise data store(For ex:Db2). Using azure express route for network connectivity between…
asked 2024-08-29T11:52:00.1366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 37%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Mani
25
Reputation points
commented 2024-09-03T21:37:03.95+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT
30,816
Reputation points Microsoft Employee
0 answers
Azure Data Factory (ADF) dataflow seems to pick the wrong endpoint when Data Preview
I have created a storage account/blob storage StorageV2 in Azure. Inside it I have created a container. Storage account automatically creates endpoints for all the provided services Then in ADF I have created a linked service (user assigned managed…
asked 2024-08-28T13:46:57.0166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 94%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKP%3C/text%3E%3C/svg%3E)
Karydakis, P (Panagiotis)
5
Reputation points
commented 2024-09-03T21:33:50.9166667+00:00
Bhargava-MSFT
30,816
Reputation points Microsoft Employee
2 answers
Power BI /Tableau Dataset Need to refresh
Hello Team, I have requirement, Where the Power BI/Tableau Dataset need to refresh after the ADF Pipeline ran successfully without any manual Interference. How this can be achievable Regards Rohit
asked 2024-08-26T16:25:03.8966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 13%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rohit Kulkarni
686
Reputation points
commented 2024-09-03T21:27:47.7733333+00:00
Bhargava-MSFT
30,816
Reputation points Microsoft Employee
asked 2024-08-21T20:10:46.3733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 88%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENK%3C/text%3E%3C/svg%3E)
Nidhi Kumari
0
Reputation points
edited the question 2024-09-03T21:26:17.1033333+00:00
Bhargava-MSFT
30,816
Reputation points Microsoft Employee
1 answer
How can I run sh codes on Virtual machine with azure datafactory ?
Hello, I need to run sh codes on azure virtual machines triggered from azure datafactory. I have an application and it needs to be schedule.I will schedule it from azure data factory. Could you please help ?
asked 2024-08-27T12:53:37.51+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 38%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMI%3C/text%3E%3C/svg%3E)
Mustafa Ispir
46
Reputation points
commented 2024-09-03T16:22:17.2033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 46%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENN%3C/text%3E%3C/svg%3E)
NIKHILA NETHIKUNTA
1,760
Reputation points Microsoft Vendor