locked
3 hours to copy a 1TB vhd from one container to another in the same storage account? RRS feed

  • Question

  • Is it normal for it to take 3 hours to copy a 1TB vhd from one container to another in the same storage account?  This is using the latest version of Storage Explorer.  I tried with AZcopy as well and had the same result.  Throughput was bouncing around between 300 and 1200 Mbps
    Tuesday, May 19, 2020 5:41 PM

All replies

  • Hello,

    What kind of storage account did you use? Was it limited on an IOPS basis?

    Regards,

    Niels

    Tuesday, May 19, 2020 6:27 PM
  • Hello,

    What kind of storage account did you use? Was it limited on an IOPS basis?

    Regards,

    Niels

    Performance: Standard
    Replication: LRS
    Account kind: Storage (general purpose v1)

    Tuesday, May 19, 2020 7:02 PM
  • Could you please try to use a general purpose v2?

    Regards,

    Niels

    Tuesday, May 19, 2020 7:12 PM
  • In Azcopy throughput for a single instance will scale at least 20Gbps 

    Which version of AZCOPY are you using? 

    You can also perform download/upload speed test: https://www.azurespeed.com/Azure/Download 

    It also depends on the bandwidth and refer to this article How Optimize performance in Azcopy

    Additional information:

     AzCopy will be making three IO Operations for every file: one to get its last modified date, one to read the data, and one to get the last modified date again to check the file didn't change while we read it. I believe that Azure will count each of those towards the IOPS limit for the disk. So if we take 180 files per second, and multiply that by the 3 operations per file, we get 540 operations per second. That's just above the 500 operations per second limit of most Standard disks. So that would explain why you can't go any faster.

    If you look at disk types and sizes here, you can probably find a large premium disk type with a much higher IPOS limit: https://azure.microsoft.com/en-us/pricing/details/managed-disks/ If you used a disk like that, it would probably be faster.

    You may refer to this GitHub link: https://github.com/Azure/azure-storage-azcopy/issues/538  

    Hope this helps!

    Kindly let us know if the above helps or you need further assistance on this issue.

    ------------------------------------------------------------------------------------------

    Do click on "Mark as Answer" and Upvote on the post that helps you, this can be beneficial to other community members.

    Wednesday, May 20, 2020 6:11 AM
  •  Just checking in to see if the above answer helped. If this answers your query, do click “Mark as Answer” and Up-Vote for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

    Wednesday, May 27, 2020 8:15 AM
  • Is there any update on the issue?

    If the suggested answer helped for your issue, do click on "Mark as Answer" and “Vote as Helpful” on the post that helps you, this can be beneficial to other community members.

    Thursday, June 4, 2020 3:30 PM