Transfer Data takes too long

Something is very wrong:

I am suppose to copy video data from an external HDD WD Red 3 TB to an other external FW disk.

The data is 78 GB. It says the time it takes: 5 days.

The HDD is in a toaster connected to the Mac Pro via USB 3.0

First I changed the cable (2x) same (there were variations of 1 day, 3 days, 5 days etc.)

I downloaded the latest CalDigi driver for te PCI card I have installed.

I connected the USB 3 to the USB 2.0 port.

There was not much change.

So I suspected the toaster is defective.

I bought a new single enclosure.

At the beginning it also showed a day or 2, but then got a bit down.... now I am at 8 h.

When I watch the copy window, it is very strange, sometimes I can see the numbers moving quick (the Gb which have been copied already) but mostly it counts very very slow.


I just wonder, where the problem could be?


Or what I could check on the Mac to pinpoint the problem.


For sure I can not work with problems like that, because I need to copy large video files all the time.


Thank you

Mac Pro, OS X Mountain Lion (10.8.5), Black Magic Extreme HD, GB RAM, 4 TB HDD

Posted on Feb 1, 2014 5:55 AM

Reply
8 replies

Feb 1, 2014 8:51 AM in response to dwctv

I don't know what a toaster is, but the bottleneck may well be the Firewire connection (the disk you're writing to). The front port of Mac Pros tends to be very slow in my experience; if you're using that, switch to a rear port.


Either way, you're unlikely to get above about 70MB/s speed through the FW port. If your other enclosure has an eSATA or USB3 port, you should use that in preference to FW800.


Or, if it's an enclosure you can remove the drive from, put it in an internal bay. If you've a bay free, you might like to test putting the original drive (what you're copying from) internally as well.


Matt

Feb 1, 2014 11:14 AM in response to dwctv

Looking at all the difficulties you describe, I'd probably just take the drive out of the FW enclosure and put it in one of the internal bays. That should speed things up to basic SATA II access speed which is about all you can hope for. If you still have speed issues, you could try the same with the toaster drive, though I've heard of Macs having issues with WD Red drives.


The realities are that FW is relatively slow and if your USB 3.0 set-up works as advertised you're one of the lucky ones. Going internal (if only temporarily) will bring you up to basic SATA II speed which should transfer the data in less than an hour.


hope this helps

Feb 2, 2014 5:18 AM in response to RatVega™

Thank you guys for your suggestions.

I was considering also to put the hdd into the Mac to eliminate any cable enclosure error. (I call a toaster an enclosure which is open on top for easy changing drives)-both were connected to the Mac via USB 3.0

But unfortunately, the installation inside the Mac did not change anything.

When I try to copy files to the desktop, it also shows many hours if not days to copy even small files.Then I either get Error 36 message or the Icons on the desktop dissappear for a while and when they come back, the copy window is gone.

I run disk utillity several times most of the times it says: nothing wrong with the drive and sometimes it gives me a warning that it can not unmount the drive.

I can access all directories and files (it just takes some time to open up)

I have posted at the WD forum but not received a reply yet.


Any more options?


Thank you

Feb 2, 2014 5:37 AM in response to dwctv

It does sound like the drive itself might have problems. Whether it's unrepairable physical issues, or directory structure issues, I can't tell.


If you have a copy of Diskwarrior, I'd recommend using that over Disk Utility's Repair Disk procedure. If not, it's a good investment - it's $100, but is very good at correcting problematic disk directory issues which can cause read/write errors or slowness.


If there are no "unique" files on the drive (ie you have backups of everything), it might be worth repartitioning and reformatting it and copying the files back.


However, if the drive has physical issues (ie, it's dying), no software will do anything for it. If you have a spare drive, and you have no backups of the files on that drive, you should copy everything off as soon as you can. If the drive is under warranty (and again, if you can copy the files off), I'd recommend you send it back to WD - they will process an RMA usually with no hassle.


Matt

Feb 2, 2014 5:53 AM in response to Matt Clifton

Thank you Matt,

but it is a bit more complicated.

The videos are originals.....I chose the WD RED, because I hoped to buy something more secure!

The drive itself does not worry my at all.... what worries me more: I have now almost 18 TB of videos on WD RED 3 TB drives. I bet on the wrong horse! I should have stayed with Hitachi.....

Hitachi failure rate was very very low. But - of course, they happen to fail too, but not after such short time.

I have no way to back up my data...where too? I have over 70 drives 3.5" and 2.5". 2.5" prove much more reliable but the max I have are 1 TBs.

It is easy to talk about backing up data...... the only option would be LTO Tapes.


BTW. I just tried to copy a 1.6 Gb video file to the desktop. First it jumped to 135 Mb (copy data) 1 min left, then to 300+ Mb then 5 min left and then Error 36.


I will wait what my post in WD forum brings, I just downloaded the Mac Drive demo for PC, last option, try to read/copy the data there.


Thanks

Feb 2, 2014 3:03 PM in response to dwctv

I have seen similar behavior. In my case I have a guess as to what is going on. I will describe what I have done and seen. If this also works for you, maybe some of the unix gurus can tell us what is really going on.


On my Mac Pro 3.1, for data I have a 3 TB WD Red and two 2 TB WD Green disks, and a 480 GB Excelsior PCIe SSD system disk running 10.9.1. I have an iPhoto library which takes over 200 GB. In addition to Time Machine and Crashplan backups, from time to time I have manually copied my iPhoto library onto a different internal disk for backup.


What I have seen is the copy starts fairly slow, with Activity Monitor reporting maybe a few MB/s read and write rates, and Finder suggesting several days to completion. If I do nothing at the computer, after about 10 minutes the copy rate jumps to 80 to 150 MB/s, and the estimated time to completion drops below an hour. If I do nothing and let the copy run, its speed may vary a little but usually it will remain very high and complete in less than an hour as Finder predicted. I think this high rate is limited only by the read and write speeds of the disks. However, if I resume work at the computer, the copy will drop to its initial slow rate and the time estimate of several days returns.


What I think happens is the copy rate is adjusted by OS X depending on whether the user is active or not. If the user is active copy is assigned a low priority (nice) and copies in small data chunks, leading to a slow copy rate. If the user is absent, copy is assigned a higher priority and works with large chunks, leading to a much faster copy.


Other parameters which I suspect may affect the maximum transfer rate are extent of available free memory, extent of fragmentation of the file being copied, and extent of fragmentation of free space on the target disk. Available free memory may limit the size of the chunks copied. Fragmentation of the file being copied may reduce the rate at which it can be read. Fragmentation of free space may reduce the rate at which the file can be written.


OS X varying the copy rate in response to user activity may explain the variation in copy rate seen by dwctv, but not the errors.


dwctv, what do you see if you start the copy and let it run with no user activity? How much free memory do you have? If you quit other applications to release more memory, does your copy reach a higher maximum rate?

Feb 2, 2014 5:11 PM in response to Tom Ritch

Tom,

for sure this I see all the time.... if I want to copy data fast, I make sure, I copy only 1 clip and then an other.

But my drive goes different: I tried to copy a small file to the desktop where I have now 56 GB space left.

First it jumps from 15 kb to a 150 Mb then 360 Mb then saying 1 Min more to go, then it says 5 min and then I get Error 36 and everything stopped. This is my latest observation. Before I tried to drag the whole folder of 76 Gb to an other disk with about 1 TB of space left. It said 5 days to copy and when I left it, a short whilelater, I got error 36 again, or the desktop icons dissappeared including the copy window and when the icons showed up again, the copy window was gone.

I have tried to catalog the disk with a 3rd part catalog software.... in 1 afternoon it was only able to catalog a view files. There is something inside which slows data transfer incredible down... so much down, that the computer gives up.


Edit:

I have 16 Gb RAM and I tried to copy right after I rebooted (did that many times to test and free up any other activity) Also mounted the drive on my Mac Book Pro in case there is a problem internally in my MP. But all the same.

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

Transfer Data takes too long

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.