Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,775 questions
0 answers
Getting Socket error code timed out while connecting to a SFTP server via Azure data factory
I am very new to Azure and My Use Case is that, I want to move the file from my Azure blob storage to a third party SFTP server. I got to know that Azure data factory will help me to move the files out by creating linked services from source and target…
Azure Blob Storage
Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,145 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,492 questions
asked 2024-09-04T04:18:44.96+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 35%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERV%3C/text%3E%3C/svg%3E)
Ridhima Verma
0
Reputation points
asked 2024-09-04T04:18:44.96+00:00
Ridhima Verma
0
Reputation points
0 answers
Google BigQuery updated linked service error: "Message=No current element is available" for empty result
I started to receive failure with error "Message=No current element is available" for Copy activity with the new Google BigQuery linked service. The legacy one doesnt throw an error/failure when the Google SQL query gives an empty result. I…
asked 2024-07-01T14:42:56.19+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 0%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EQD%3C/text%3E%3C/svg%3E)
Quyen Dang
16
Reputation points
commented 2024-09-04T01:53:59.6533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 43%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Monem Metwally
5
Reputation points
0 answers
ADF Pipeline Parameter Treated as Integer Instead of String When Triggered by Schedule
Hey All, Hoping you can help with a really strange issue we’re encountering with ADF pipeline parameters and scheduled triggers. We’ve got a pipeline parameter of type string that defaults to "-1" when nothing is passed through. Everything…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 4%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EUF%3C/text%3E%3C/svg%3E)
1 answer
How do I parameterize key vaults and secrets in an ADO release pipeline for ADF
Hi, I am building a release pipeline in Azure DevOps to deploy from my Dev ADF into my Prod ADF. A lot of my linked services use a key vault with a secret to connect, however this is not exported in the ARM template parameters so I can parameterize in…
asked 2024-09-03T13:43:04.75+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 16%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDR%3C/text%3E%3C/svg%3E)
Diana Rus
0
Reputation points
answered 2024-09-03T22:28:45.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
14,140
Reputation points Microsoft Vendor
0 answers
Azure data factory snowflake connector v2 connection issues
I'm working on an azure datafactory system that loads data into Snowflake using the existing / V1 Snowflake connector I saw an alert on the data factory portal warning that the connector is being retired and advising to use the Snowflake connector…
asked 2024-08-28T11:03:24.9566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 50%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
SteveAtMSLearning
0
Reputation points
commented 2024-09-03T22:25:00.2333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT
30,406
Reputation points Microsoft Employee
0 answers
Exporting data via an OData API
I am experiencing issues while attempting to retrieve data from multiple Cornerstone OnDemand (C SOD) API views using Azure Data Factory. The process works seamlessly on Postman, but when implemented in ADF, I encounter authentication and request…
asked 2024-09-03T11:07:57.1066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 17%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Anna Kelava
0
Reputation points
commented 2024-09-03T22:06:11.67+00:00
Smaran Thoomu
14,140
Reputation points Microsoft Vendor
1 answer
Secure Data connection from Data Factory.
Hi, We are using Data factory service in Azure and created "Selfhosted Integration Runtime" on the window virtual machine in azure for connecting on-premise data store(For ex:Db2). Using azure express route for network connectivity between…
asked 2024-08-29T11:52:00.1366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 37%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Mani
25
Reputation points
commented 2024-09-03T21:37:03.95+00:00
Bhargava-MSFT
30,406
Reputation points Microsoft Employee
0 answers
Azure Data Factory (ADF) dataflow seems to pick the wrong endpoint when Data Preview
I have created a storage account/blob storage StorageV2 in Azure. Inside it I have created a container. Storage account automatically creates endpoints for all the provided services Then in ADF I have created a linked service (user assigned managed…
asked 2024-08-28T13:46:57.0166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 94%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKP%3C/text%3E%3C/svg%3E)
Karydakis, P (Panagiotis)
5
Reputation points
commented 2024-09-03T21:33:50.9166667+00:00
Bhargava-MSFT
30,406
Reputation points Microsoft Employee
2 answers
Power BI /Tableau Dataset Need to refresh
Hello Team, I have requirement, Where the Power BI/Tableau Dataset need to refresh after the ADF Pipeline ran successfully without any manual Interference. How this can be achievable Regards Rohit
asked 2024-08-26T16:25:03.8966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 13%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rohit Kulkarni
686
Reputation points
commented 2024-09-03T21:27:47.7733333+00:00
Bhargava-MSFT
30,406
Reputation points Microsoft Employee
asked 2024-08-21T20:10:46.3733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 88%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENK%3C/text%3E%3C/svg%3E)
Nidhi Kumari
0
Reputation points
edited the question 2024-09-03T21:26:17.1033333+00:00
Bhargava-MSFT
30,406
Reputation points Microsoft Employee
1 answer
To copy data from single payload to multiple tables.
I have a JSON payload containing student information stored in an Azure Blob container. The JSON includes details like StudentName, age, address, course, semester, universityName, universityAddress, and universityRating. I need to transfer this data from…
asked 2024-08-26T13:33:55.1166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 61%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Ashish Adhikari
0
Reputation points
edited the question 2024-09-03T21:22:38.25+00:00
Bhargava-MSFT
30,406
Reputation points Microsoft Employee
0 answers
Azure Data Factory GitHub Actions getting the error message "InvalidContentLink"
I'm stuck on the following error message: Error: ERROR: {"code": "InvalidContentLink", "message": "Unable to download deployment content from '/ArmTemplate_0.jsonsig=Sanitized Azure Storage Account Shared Access…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 52%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJV%3C/text%3E%3C/svg%3E)
0 answers
Not able to execute Snowflake stored procedure from ADF via Script or Lookup activity
I am not able execute Snowflake Stored Procedure which accepts parameters from ADF via Script or Lookup activity. Though I know Script parameters are not supported in Script activity currently after update but also as suggestion, I have tried to use a…
asked 2024-08-30T14:01:27.6066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 47%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESB%3C/text%3E%3C/svg%3E)
Satish Burnwal
0
Reputation points
commented 2024-09-03T21:18:29.3033333+00:00
Bhargava-MSFT
30,406
Reputation points Microsoft Employee
0 answers
Getting error on trying to call a REST API on Data Factory
Through Postman, I'm able to request a token using the following curl request - some info were hidden for security purposes. curl --location 'https://hidden/Token' \ --header 'Content-Type: application/x-www-form-urlencoded' \ --data-urlencode…
asked 2024-09-03T18:32:30.7466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 25%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJL%3C/text%3E%3C/svg%3E)
Joffre L. A. Mota (LG lugar de gente)
0
Reputation points
asked 2024-09-03T18:32:30.7466667+00:00
Joffre L. A. Mota (LG lugar de gente)
0
Reputation points
1 answer
How can I run sh codes on Virtual machine with azure datafactory ?
Hello, I need to run sh codes on azure virtual machines triggered from azure datafactory. I have an application and it needs to be schedule.I will schedule it from azure data factory. Could you please help ?
asked 2024-08-27T12:53:37.51+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 38%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMI%3C/text%3E%3C/svg%3E)
Mustafa Ispir
46
Reputation points
commented 2024-09-03T16:22:17.2033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 46%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
NIKHILANETHIKUNTA
1,425
Reputation points Microsoft Vendor
0 answers
How to fix web activity error "Error calling the endpoint" for Azure API management service from Azure data factory
I have an azure data factory in VNet and API management service with virtual network type "Internal". I am trying to invoke one of the Api endpoints from data factory using web activity "POST" method but getting the below mentioned…
asked 2024-04-22T21:50:32.2266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 55.00000000000001%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECV%3C/text%3E%3C/svg%3E)
Chodisetti, Veda
0
Reputation points
edited a comment 2024-09-03T15:50:47.6666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 67%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPR%3C/text%3E%3C/svg%3E)
Puffer, Robert
0
Reputation points
1 answer
ADF: Table type parameter in ADF copy activity source
I'm want to move data form source DB to Target DB. I'm using series of copy activity to move the data form source to target. In copy activity in the source I'm calling stored procedure and what ever SP returns that I'll dump in target DB using sink. In…
asked 2022-07-27T07:26:52.657+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 66%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESB%3C/text%3E%3C/svg%3E)
Sridhar Boopalan
1
Reputation point
commented 2024-09-03T15:29:50.64+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 78%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKK%3C/text%3E%3C/svg%3E)
Krishna Kumar Velayudham
0
Reputation points
1 answer
One of the answers was accepted by the question author.
Optimizing Azure Synapse Analytics for Spark Pool and Mapping Data Flows
I am encountering errors involving Livy sessions when running multiple pipelines in Synapse Notebook and mapping data flows. The errors are as follows: For notebooks: Operation on target forecast_constrained failed: Exception: Failed to create Livy…
asked 2024-08-29T08:21:28.3033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 69%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Aditya Singh
130
Reputation points
accepted 2024-09-03T14:35:59.04+00:00
Aditya Singh
130
Reputation points
1 answer
Json file load in adf
Hi, how to run json file on synapse workspace.. Tried with data flow but not reading files after data using flattens transformation... convert in parquet..Pls share screenshot(file attached). have selected …
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 13%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
0 answers
Json in synapses
Hi, how to run json file on synapse workspace.. Tried with data flow but not reading files after data using flattens transformation... Trying convert in parquet..Pls share screenshot(file attached). have selected …