Pass parameters from Web App to Azure Data Factory Pipeline

jigsm 236 Reputation points
2020-11-03T02:56:06.517+00:00

Respected,

We are designing a Azure Data Factory Pipeline where in a user will upload a file from Web App, the uploaded file will be stored in Azure Blob Storage and the trigger set in

the pipeline will trigger it.

Now, my question is how to pass parameters like the userId from Web App to the pipeline. I need this value to store against the data that is being processed by the pipeline.

Any pointers will be helpful!!

Regards

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,679 questions
0 comments
Accepted answer
  1. HarithaMaddi-MSFT 10,136 Reputation points
    2020-11-03T09:25:13.983+00:00

    Hi @jigsm ,

    Welcome to Microsoft Q&A Platform. Thanks for posting the query.

    We can only pass folder path and file name as parameters to pipeline when using event triggers in azure data factory, please refer to this document. Workaround I can think of would be to add the user id as one column in the file when uploading to blob storage. And lookup activity can be used in the pipeline that can read the first row from the file and user id column value can be assigned to a pipeline variable using set variable activity post this. The variable can be used in a way that is needed and user id can be skipped loading into the destination.

    37069-image.png

    If adding flexibility to pass more parameters to event triggers is helpful, I would recommend to post an idea in feedback forum that is closely monitored by data factory product team and will be prioritized in future releases.

    Please suggest if this does not align with the requirement or for further queries and we will be glad to assist.

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.