How long does it take to consolidate 8TBs in iTunes Library?

My iTunes says I have an 8TB Library. Currently I have it spread across 5 hard drives. Having had three hard drives die, I'm concerned about the ones currently in operation. The three that died, perhaps not coincidentally were all Seagate drives. I recently purchased a 20TB G-Drive unit that I want to use as a back-up. I don't think I can use Time Machine for just the files that are in my iTunes library, because I don't want to back up everything on my current hard drives—just the music in iTunes. There's lots more I've deleted from iTunes but not the hard drives that I don't want backed up.


My plan, when the new hard drive arrives (tomorrow) is to consolidate the Library there but still keep using my current set-up. Going forward I'll drag new things to the new hard drive, so I'm hoping when/if I lose anything it won't be too difficult to access replacement copies.


I'm thinking I'll need to change the location of my library to the new hard drive, then perform consolidation.


I'm wondering if anyone knows how long I should expect this to take. I'm guessing quite a while, but if it's days instead of hours, I know I'll start to wonder.


My computer is a new Mac Mini and the G-Drive is Thunderbolt 3, so I'm thinking it won't take as long as it could. But I know it might take longer than I'm comfortable with.


What happens if there's an interruption in power? Maybe I'd have to start all over again?


The computer won't go to sleep while it's still working, I hope.


Does this put extra stress on my current hard drives, being accessed for so long?

Can I use my Mini for other tasks while I'm waiting with bated breath?


And when the consolidation is accomplished will it be a new Library on the new hard drive I'll be working with? If so, will the old version of the Library be something I'll need to revert back to (holding down the shift key opening iTunes)?


My first step, of course, will be to make a copy of the Music folder, with the Library in it, before proceeding. But I know I'm not the most computer-savvy person. Not by a long shot. A lot of my experience has been with screwing up. So I'm fearful this procedure might not go well, most likely because of something I'll do wrong.


Any thoughts?

Mac mini 2018 or later

Posted on Jan 6, 2020 6:27 AM

Reply
Question marked as Top-ranking reply

Posted on Jan 6, 2020 7:00 AM

I suspect copying 8Tb worth of files might be in the order of days. Instead of one mammoth operation you can select batches of files and use File > Library > Consolidate Files to consolidate just the files in that batch that aren't already in your designated media folder. See Make a split library portable - Apple Community for general background on library organization. I would suggest you start by copying your existing library files into <NewDrive>/iTunes, option-start-iTunes (shift is for Windows) to connect to the new copy of the iTunes Library.itl file, reset the media folder to <NewDrive>/iTunes/iTunes Media, then work slowly from there.


For selecting batches to consolidate you could create a regular playlist called, say, Consolidated, and a smart playlist called Consolidate. Make the rules of the smart playlist Playlist is not Consolidated, and limit to say 1,000 items to start with, selected by Artist. Select all in Consolidate with Cmd+A, consolidate those items, drag the selection to the Consolidated list, a new batch of items will appear. Repeat until done, changing the batch size as appropriate so each batch doesn't tie things up for too long, but you don't have to do too many batches.


tt2

Similar questions

24 replies
Question marked as Top-ranking reply

Jan 6, 2020 7:00 AM in response to cdrumm

I suspect copying 8Tb worth of files might be in the order of days. Instead of one mammoth operation you can select batches of files and use File > Library > Consolidate Files to consolidate just the files in that batch that aren't already in your designated media folder. See Make a split library portable - Apple Community for general background on library organization. I would suggest you start by copying your existing library files into <NewDrive>/iTunes, option-start-iTunes (shift is for Windows) to connect to the new copy of the iTunes Library.itl file, reset the media folder to <NewDrive>/iTunes/iTunes Media, then work slowly from there.


For selecting batches to consolidate you could create a regular playlist called, say, Consolidated, and a smart playlist called Consolidate. Make the rules of the smart playlist Playlist is not Consolidated, and limit to say 1,000 items to start with, selected by Artist. Select all in Consolidate with Cmd+A, consolidate those items, drag the selection to the Consolidated list, a new batch of items will appear. Repeat until done, changing the batch size as appropriate so each batch doesn't tie things up for too long, but you don't have to do too many batches.


tt2

Jan 6, 2020 7:58 AM in response to cdrumm

Consolidating retains checked status, playlist membership, date added, etc. Importing to a fresh library does not. The new Music, TV and Podcasts apps in Catalina are somewhat different from iTunes. If you're going to be using the library with Music rather than iTunes you might prefer to start with the folders Music and Media instead of iTunes and iTunes Media.


tt2

Jan 7, 2020 3:21 AM in response to cdrumm

Rats, another lost feature in Music. You can no longer consolidate a selection of files. Using the Automatically Add to Music folder will make copies, which isn't what you want. You may have to go with consolidating the whole library after all. The alternative would be to use a script for the process, but I don't see anything readily available at https://dougscripts.com/. Renaming tracks in their existing folders is easy enough, I've written my own AppleScript for that, and Doug has something that looks quite polished, but it doesn't appear that it can move/copy the tracks to a new volume/path. I've a Windows solution for that, but it isn't a simple port into AppleScript.


tt2

Jan 8, 2020 6:59 PM in response to cdrumm

Select a track with an exclamation mark, press Cmd+i to get into, select no when asked to locate the track, then look at the location given on the File tab. Can you find this track on one of your volumes? With both paths to hand I can describe what to do to make the file accessible so that it can be consolidated to the new media folder, along with any others that are in the same set of related folders.


tt2

Jan 6, 2020 7:44 AM in response to cdrumm

Sounds like something I, and my Mini, might be more comfortable with. I had toyed with the idea of sorting the library by "Date Added" and just dragging it all incrementally, oldest stuff first keeping track where I'm at. But those music files would have to re-input into iTunes, or rather "Music". Also, I have lots of songs I've unchecked when I used them in playlists I upload to Mixcloud [https://www.mixcloud.com/cdrumm/] that I don't want to show up in future playlists, when I do my regular random cull. So I don't want to lose that info in the back-up.

Jan 6, 2020 9:48 AM in response to turingtest2

Yes, it is Music now—not iTunes. I still call it iTunes by habit but I'm glad to have the music in a standalone app, since I haven't been using Podcasts in a while, or TV ever. I did make the move to Catalina. It took a while (and maybe the later OS update) for Music to load in less than forever, but it's been fine lately. A few things that were changed up I found when I figured them out were indeed improvements. And with the Mini instead of my older MacBook Pro running the hard drives, things are really speeded up.

My new hard drive arrived today instead of tomorrow, but I'm not plugging it in just yet. The Thunderbolt 3 cable doesn't reach to where I'd hope it would, under my desk. (Maybe if I drilled a hole!) I want to have everything turned off before I start moving things around.

Thanks for responses, tt2! It's good having a Level 10 on my case.

Jan 6, 2020 6:12 PM in response to turingtest2

tt2:

I'm doing a test run of your Consolidate smart playlist to Consolidated playlist system with my MacBook Pro and 1TB portable hard drive. On my Mini all 500,000 songs will end up in the Consolidated folder? It seems they don't actually get moved to the new drive unless I drag them into the Automatically Add to Music folder on the new drive. I could do that incrementally. Is that what you suggest?

If I remove any from the Consolidated folder won't they be eligible to be put in the Consolidated folder again. Or will the Smart Playlist keep working down the Artist list?

Jan 7, 2020 1:44 PM in response to turingtest2

Boo hoo! It didn't quite work out as hoped. The consolidating bogged down I think with the music files that were in the Library but couldn't be found, because they were originally on a defunct hard drive. They were still in the Library, which is what was being Consolidated, because I wanted to keep track of what I didn't have and needed to replace.

Only 0.4TBs are now on my new 20TB G-Drive, where there should be at least six or seven out of the 8.04 that the Library has indexed.

I guess I'll have to just drag stuff willy-nilly onto the new big-*** hard drive for back-up, and try to figure out what. The Library, now situated on the new G-Drive, looks to be fully functional and good to go, albeit with the songs still on the hard drives I was trying to back up. Maybe moving to the G-Drive is what I should be doing anyway.

I have more confidence in G-Drive than the 8TB Seagate thing I'd been all too reliant on for too long (maybe—it hasn't yet shown signs of failure). But with so much storage space now, everything is fine as far as I can tell. Maybe I can come up with a workaround that will make things even better going forward. A blessing in disguise?

Jan 9, 2020 8:45 AM in response to cdrumm

I'd suggest you don't touch anything that has already copied over.


This entry from Get Info


file:///Volumes/seagate 4tb/Compilations/Walking The Blues/10 Bad Condition.m4a


Tells me that when that file was added to the library the media folder was effectively /seagate 4tb/. You said there were backups. If you have another drive, called bob for example that has a folder called backup inside of which is this Compilations folder, and perhaps other artist folders, then those could be moved to the root folder of bob and bob could be renamed to seagate 4tb. If you now restart Music* it should be able to find the track at /seagate 4tb/Compilations/Walking The Blues/10 Bad Condition.m4a and play it, and if you consolidate the library once more all tracks that weren't previously found but are now visible on their expected paths can be consolidated. Anything that has already been consolidated to the G-Drive will be left alone.


You can repeat the process above as necessary for different batches of music that have been backed up to different drives.


* When you start Music or iTunes it assumes tracks on all paths are available until it has reason to notice otherwise. Once it has noticed that a file cannot be reached because a drive is missing adding the drive, or renaming an existing one, won't change the exclamation mark status. Individual tracks can be repaired by playing them, but consolidate will assume they are missing and ignore them.


tt2

Jan 9, 2020 9:19 AM in response to turingtest2

I don't have back-up files of the songs missing from dead Seagate 4TB—just the original CDs which I've been re-inputting gradually. Downloads I did have backed up and restored quite a lot until the back-up hard drive (another Seagate 4TB) also quit working. Also croaking was a portable Seagate 1.5TB I'd been using for downloads more recently (2017). That one also was a supposed back-up for Seagate 4TB. Again, I'd restored quite a lot but by no means everything.

Re "consolidate will assume they are missing and ignore them" — if so then maybe that wasn't what caused it to stop working the first time. It could have been something else. If it happens again, I'll be sure to get a screen grab of the alert. I do know it wasn't too specific about any file missing or particular cause. All I could do was click okay and have it go wild organizing for a while (maybe 15-30 minutes—which would be that much longer with the whole Library, were I to be so lucky.)

Jan 9, 2020 9:53 AM in response to turingtest2

I'll go ahead with the re-consolidation and see how far it gets. I've made copy2 of Music folder and am re-opening Music choosing the copy2 Library. I've made a new folder on the G-Drive and will set that as the Media destination. Then, I guess, Organize and Consolidate. If it doesn't work I won't be totally dead, so no real worries.

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

How long does it take to consolidate 8TBs in iTunes Library?

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.