Today we are announcing the general availability release of AzCopy on Linux. AzCopy is a command line data transfer utility designed to move large amounts of data to and from Azure Storage with optimal performance. It is designed to handle transient failures with automatic retries, as well as to provide a resume option for failed transfers. This general availability release includes new and enhanced features, as well as performance improvements thanks to the feedback we received during the Preview.
You can get started with the latest AzCopy release following the documentation.
Throughput improvements up to 3X
Investments in performance improvements and leveraging .Net Core 2.1 have boosted the AzCopy throughput significantly. In our tests, we have seen up to three times the improvement in throughput for large, multiple files as well as up to two times the throughput improvement in scenarios where millions of small files are transferred.
AzCopy now packages .NET Core 2.1 thereby eliminating the need to manually install .NET Core as a pre-requisite. You can now extract the AzCopy package, and start using. You might however need to install the .NET Core dependencies in some Linux distributions. Please consult the documentation for the installation instructions.
Pipe from stdin
AzCopy now supports redirecting from standard input, which was a frequent ask by our users. Just gzip and upload to Blob in a single command. Below is a sample.
gzip mydata -c | azcopy --destination https://myaccount.blob.core.windows.net/mycontainer/mydata.gz --dest-key <redacted>
Single File support
AzCopy on Linux, as well as on Windows, now supports transferring a single file to and from Azure Storage. This was a frequent ask by our users who wanted to move large disk images. This is now as simple as:
azcopy –source https://myaccount.blob.core.windows.net/mycontainer/mydata.gzip --source-key <redacted> --destination https://myotheraccount.blob.core.windows.net/mycontainer/mydata.gzip --dest-key <redacted>
As always, we strive to make everything better in Azure! Let us know should you have any feedback about AzCopy.
Happy data transfers! AzCopy Team