Data Factory's Data Flow cost structure

Renan Nascimento 20 Reputation points
2024-07-10T17:56:32.1066667+00:00

Hi all,

I have a question regarding the cost structure for Data Factory's Data Flow.
Is the charge solely per cluster/integration runtime, or are the costs doubled if two pipelines run simultaneously, I mean, both using the same cluster/integration runtime?

Thanks in advance,
Renan Nascimento

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,520 questions
{count} votes

Accepted answer
  1. Vinodh247 16,751 Reputation points
    2024-07-11T00:35:28.48+00:00

    Hi Renan Nascimento,

    Thanks for reaching out to Microsoft Q&A.

    • ADF Data Flows use Azure Integration Runtime, which can be of two types: General Purpose and Memory Optimized. You will be charged for the compute resources allocated to the integration runtime which will be measured in Data Flow Compute Hours.
    • The cost is calculated based on the duration the integration runtime is active. The charge starts when the compute resources are allocated and stops when the data flow activity completes. The charges are for per Data Flow execution & this includes the compute time for transforming data within your Data Flow.
    • The cost is based on the vCore-hours consumed by the Data Flow cluster, not the number of pipelines using it. If two pipelines run simultaneously on the same Data Flow cluster, you would be charged for the total vCore-hours consumed, not double the amount.

    To sum it up....

    Shared Resources: Costs do not double simply because two pipelines run simultaneously. The charge is based on the compute resources consumed.

    Scaling Out: If the existing cluster cannot handle the load and additional clusters are allocated, costs will increase accordingly.

    https://azure.microsoft.com/en-us/pricing/details/data-factory/data-pipeline/

    Let me know if you have any other questions.

    Please 'Upvote'(Thumbs-up) and 'Accept' as an answer if the reply was helpful. This will benefit other community members who face the same issue.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.