'ADLS Gen 1 with Synapse Notebook Scala

I am not able to find the way to connect ADLS Gen 1 in a synapse notebook. I already have existing linked service for ADLS Gen 1. I have seen some of the documentation online but all are related to ADLS Gen 2. Please provide some help/references for connect and read csv/json from ADLS Gen 1 with synapse notebook using Scala.

I have found that mounting ADLS Gen 1 with mssparkutils is not supported in official document.

azureazure-data-lakeazure-synapse


Solution 1:[1]

As per this Microsoft official documentation:

On Feb 29, 2024 Azure Data Lake Storage Gen1 will be retired. If you use Azure Data Lake Storage Gen1, make sure to migrate to Azure Data Lake Storage Gen2 prior to that date.

Therefore there isn't any support available for your requirement, i.e., to mount the ADLS Gen 1 to synapse notebook.

The maximum you can do is:

  1. You can load the data from ADLS Gen 1 storage to Dedicated SQL Pool using Copy statement. You can refer this tutorial for the same.

  2. You can link the ADLS Gen 1 with Azure synapse analytics and then perform the required operation on the stored files. Refer below image to link ADLS Gen 1 using Synapse Workspace.

enter image description here

I recommend you to Migrate your data lake from Gen1 to Gen2 to avoid any issue in future.

Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source
Solution 1 UtkarshPal-MT

Related Questions