Azure Datafactory passing parameter to a datasource on a dataflow

Higor Silva Grilo 66 Reputation points
2020-09-17T13:28:03.867+00:00

Hi,

I'm trying to pass a parameter from a pipeline into a dataflow, which has some datasources, and these datasources has parameters that i want to fulfill.

This is an overview from my pipeline, and there is too the parameters that i want to pass to the datasource inside the dataflow.
25623-image.png

On my dataflow do have these datasources, but i don't use the wildcard on path, i want to use the parameters to create my path string, or pass the parameters into the datasource.
25641-image.png

Here is the datasource, where i manage the parameter to create the path string:
25480-image.png

My question is: how can i make the parameter value get to the datasource? because in my tests, the parameter isn't changed, it's always used the default value.
Or if this isn't the best way to do it, how can i use a dynamic parameter to create the path?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,570 questions
0 comments

3 additional answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. HimanshuSinha-msft 19,471 Reputation points Microsoft Employee
    2020-09-17T22:11:22.96+00:00

    Hello @Higor Silva Grilo ,

    Thanks for th question and welcome to the forum .
    As i understand the ask , you are able to run the pipeline but the parameter which are passed to the pipeline is not getting to dataflow and so its getting a default value . Your first and second images appears to the same .

    I think you are missing the mapping ( check the third images below )
    25645-11.png

    25666-22.png

    25588-33.gif

    Please do let me know if you are still facing the issue .

    Thanks Himanshu
    Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

    0 comments
  2. Higor Silva Grilo 66 Reputation points
    2020-09-18T13:11:32.477+00:00

    Hi HimanshuSinha-MSFT, thank you for the answer.

    Sorry if i didn't showed in my first post, i was already using the Pipeline Parameters on my dataflow:
    Parameter definition on dataflow:
    25845-dataflow.png

    The pipeline parameter being passed to the dataflow parameter
    25794-image.png

    The datasource configuration getting the value from parameters and creating the dynamic path to the file
    25846-datasource.png
    Should this be enought to get the path to point to the right file? or should i point to the folder where the file is?

    Here is something interesting, running the pipeline, when i look to the execution info: i can get the parameter on data flow, but seems that the datasource is using the default value:
    25768-execution.png

    0 comments
  3. Higor Silva Grilo 66 Reputation points
    2020-09-22T13:04:33.72+00:00

    @HimanshuSinha-msft i've tried to point to the file and to the folder where the file is, but with no success.
    Any help to make the dataflow pass the parameter to the datasource?

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.