Local Copies are fast but with long pauses between files.

[Enlightend]

For starters, this is not a performance issue in the classic sense.

When a copy or move is actually happening, it's going blazingly fast.

The scenario:

I have 8 TB of data that I'm currently trying to move from my old tank with 1TB disks to a new one with 3TB disks. (the 1TB disks will be tested and repurposed to a Mirrors pool for ESXi)

The issue:

When transfering a +1TB file, transfer speed for the file is +200MB/s for the entire duration.
When transfering a 2GB file, transfer speed is equally good.

But when transfering a directory with 100 2GB files, although the transfer speed for each file is still +200MB/s, there are minute long pauses between the transfers of each file.

Short of trying other ways of copying that data (share to share, iscsi to iscsi, etc which are all over the network) what could cause these long pauses and how can I fix that.

I'm wondering if it's because a local copy command might not get enough priority to work fast.

Anyone have any idea's how to get this copy going at full speed?

I'm running 9.3.

Don't know what other info could be relevant towards this type of problem. There is no issue with the storage backend, it's plenty fast, the only issue is long pauses between tranfers in a multi file copy or move.

 

[cyberjock]

Give the forum rules a read and edit your post.


Thanks.