'How to automate the execution of scripts in Azure compute instance?

Currently, I am working on automating an ML pipline in Azure.

Manualy:

  • I start the Azure compute instance
  • I start a terminal, change the directory, and activate my venv
  • Then I run some commands of Docker (docker build, docker-compose up ... )

The results (output) of the ML pipeline are saved in an Azure datalake to be used later.

My question is how to automate this process?

What exactly I want to achieve is automate all this process [ at a certain date day in the month, the Compute Instance should start and execute all the pipline and stop automaticaly ]

Is there any good practices to do so?

Thank you



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source