'Using Databricks/Python3.x ZipFile to extract 7gb file from zip

I've got a large NPI zipfile which includes a 7.3gb csv. (file can be located on NPI site here: http://download.cms.gov/nppes/NPI_Files.html -- the Full Replacement Monthly NPI File)

When using extractall, every file is extracted to the proper location and all files are correct, with the exception of that 7gb file. It only extracts to 108.9 KB.

Here's the code...

with zipfile.ZipFile(sourcePath, mode='r') as zip_ref:
  zip_ref.extractall(destinationPath)

I even added ", allowZip64=True" just in case, but it still only unzips the file to 108k.

Any idea what I can be doing wrong here?



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source