Rerun from the next activity in the Data Factory piepline

susheel 1 Reputation point
2020-11-25T00:15:33.197+00:00

Lets assume that I have a pipeline with activities A->B->C->D

If an activity B fails then I know that we can rerun from the failed activity B.

Lets say if an activity B fails and I want to skip Activity B and run from Activity C. Can we do that in data factory?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,833 questions

3 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Nasreen Akter 10,791 Reputation points
    2020-11-25T21:06:40.6+00:00

    Hi @susheel ,

    I agree with @HarithaMaddi-MSFT . If you always want to proceed the run despite of any activity failed, you can proceed with this approach. Otherwise, you can manually run the pipeline with the following steps:

    1. in the Debug-mode, clone the main Pipeline.
    2. delete activities from the pipeline which you don't want to run.
    3. run the pipeline in debug mode by passing the same parameters (if you have any).
    4. you can discard all the changes after the run completed.

    Please Accept Answer and Up-vote if the response helped. Thanks!

    1 person found this answer helpful.
    0 comments
  2. Vaibhav Chaudhari 38,746 Reputation points
    2020-11-25T05:42:20.21+00:00

    I tried this and seems it is not possible

    I clicked on Wait3 activity and clicked Rerun from Wait3 activity. Since earlier Wait2 activity is failed Wai3 can not be run. Probably in such cases, you will have identify and fix failed activity first

    42581-image.png

    ----------

    Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

    0 comments
  3. HarithaMaddi-MSFT 10,136 Reputation points
    2020-11-25T09:07:29.91+00:00

    Hi @susheel ,

    Welcome to Microsoft Q&A Platform. Thanks for posting the query.

    The dependency among activities can be "success", "failure", "completion" and "skipped" as shown below and detailed explanation can be found in this document. If we set the dependency as completion even though wait2 activity failed below, wait3 executed.

    42524-image.png

    Please suggest if this does not align with the requirement and we will be glad to assist further.

    ---------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.
    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.