'Is there any guideline how track changes to an ADF pipeline source code in a Git repository?

I am developing have a few relatively complex ADF pipelines and I like to track my changes.

Traditionally with programming languages I keep my code in a git repository and track changes using branches.

How can I do the same for ADF pipelines? What is the recommended directory structure for ADF code?



Solution 1:[1]

Source control of ADF should be what you are looking for. It can track the changes in underlying JSON using git.

It also provides some useful features when you integrate with a Github / Azure DevOps Repo:

  1. "auto" save/commit; every time when you save your work, the change is created as git commit as incremental change and you can easily revert it. In this way, you do not have to publish your changes to persist your changes(In some case like developing a new feature on a feature branch, publishing may not an option)
  2. You can leverage branch protection in Github / Azure DevOps Repo to perform code review, code merge... before publishing the ADF code

But to be honest, from my personal experience, it is not very useful for diff as the JSON does not have any linebreaks and it is hard to find the diff between versions.

Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source
Solution 1 ray