ADF publishing from Main

Santhi Dhanuskodi 265

Hi,

I am publishing from main branch using the publish link in ADF.

I am expecting that it will publish all code like pipelines, datasets, dataflows etc to live mode.

But thats not happening. What is publishing do? We are trying to create trigger through Terraform code, and thats failing with the error 'pipeline not found'.

Need knowledge on this.

Bhargava-MSFT 30,296 Reputation points Microsoft Employee

2024-07-16T17:48:06.3933333+00:00
Hello Santhi Dhanuskodi

If you are using Terraform to deploy changes to ADF, it is possible that the "last published commit id" is not being set correctly or is being set to an old value or null. This can cause ADF to consider all changes to resources after that commit id as "new" and not publish them.

To resolve this issue, you can try the following steps:

Check the Terraform code that you are using to deploy changes to ADF. Make sure that the "last published commit id" is being set correctly and is not being set to an old value or null.

If the issue persists, try manually publishing the changes in ADF and see if they are published correctly. This will help you determine if the issue is with the Terraform code or with the ADF configuration.
Santhi Dhanuskodi 265 Reputation points

2024-07-17T05:42:13.5566667+00:00

I am manually publishing the code from main. But I cannt any pipelines, dataflows etc in live mode.

May I know what 'publish' does? what code is generated in what branch? what are the different actions happening on publish?

Why I cannt see anything in live mode? There were no errors while publishing manually.
Bhargava-MSFT 30,296 Reputation points Microsoft Employee

2024-07-22T15:36:03.58+00:00

Santhi Dhanuskodi

I am checking to see if you have any further questions here.

3 answers

Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Comments have been turned off. Learn more
Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Comments have been turned off. Learn more
Bhargava-MSFT 30,296 Reputation points Microsoft Employee

2024-07-17T23:01:01.2+00:00
Publish should generate an ARM template for all the resources like pipelines, datasets, and dataflows, and then deploy them to the live mode. The ARM template is typically generated in the adf_publish branch, which is a system-generated branch used for this purpose.

During the publish process, ADF generates two main ARM templates.

ARMTemplateForFactory.json

ARMTemplateParametersForFactory.json

During the publishing processL

ADF validates the resources to make sure there are no conflicts.

Template Generation and stores them in 'ADF_Publish' branch

Deployment to live

If you are still not seeing resources in live mode:

Check Git configuration in your ADF workspace is correct and that changes in the master branch are reflected in the live mode

Any brach conflicts

Can you try manually deploy the ARM templates from the adf_publish branch to live mode.

Check permissions
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

ADF publishing from Main

3 answers

Your answer