"Home Directory Full" message "fix doesn't work for me

Question

"Home Directory Full" message "fix doesn't work for me

Often (no, not always, it's not consistent), I get the dreaded "Home Directory full" message when I launch mail. Mail then quits when I click OK. Normally, if I launch it again right away, it works.

I tried to use the standard fix (e.g., removing the "Envelope Index" file to the desktop and launching Mail). This did cause a dialog to pup up informing me that I needed to re-index my mail file. I did that, and the process stopped with the progress indicator about two thirds through. I quit Mail and replaced the Mail folder in Library with the backup I had made before getting started.

Next, I tried the Hoover method (running the vacuum command from the Terminal. My machine grinded away for some time. I don't know how far it got (there is no progress indicator nor any other feedback of any kind), but since nothing happened for a good half hour (with no more disk activity for a long time), I quit that process, too. Get info revealed that the "Envelope Index" file had not been modified at all by this. Again, just to be on the safe side, I replaced the Mail file again with the backup copy.

Because the re-indexing in my first attempt had stopped while processing my sent items folder, I suspected that this one was the culprit. I therefore attempted to rebuild it (via the menu command in Mail). Much to my surprise, the process actually finished without an error message. However, my sent items folder now contained some 5,200 emails as opposed to the 7,00 or so it should have.

Then I saved my Mail preferences file to the desktop, made a backup copy of my Mail backup file, and launched Mail. This made the application believe that it was being launched for the first time. I used the Import command and imported only the contents of the Sent Items mailbox, specifying "Other" as the type. This imported 5,225 items; at that point, the progress indicator was showed a fully completed process, even though the "messages" folder contained 7,900 items. Checking things, I found that there was a discrepancy of 9 items (i.e., the last item that showed as having been imported was not the 5,225th item in the "messages" folder, but rather the 5,216th). I thus moved the first 5,216 items from the messages folder into a different folder and tried to import the rest. Much to my surprise, Mail imported the same 5,216 items all over again. This is when I noticed that it does not import from the "messages" folder but rather from the file called "mbox".

And this is where things stand. I still get the "Home Directory Full" message about once out of two launches of Mail (but never once Mail is up and running). I desperately need to get this fixed as I fear I'm on the brink of a disaster with my mail file.

One more clue: I cannot be 100% sure, but it seems to me that the problem began when I added a second dot mac email account to my Mail setup (we have a family pack; I always managed the main account and have more recently added one of the sub-accounts to my configuration). I also noticed that sometimes, this second dot Mac account shows up in my list of mailboxes on the left side of the screen, and sometimes it doesn't. Both these accounts are configured to be checked automatically. In addition to these IMAP accounts, I have a half dozen POP3 accounts and some 40 or 50 local mailboxes configured.

Does anyone know of a utility I can use to rebuild my entire email file instead of just the index? Or does anyone have any suggestions as to how I can manually fix things? I did do the usual stuff already (using disk utility to check the disk, fixing permissions, and so on) without detecting any problems.

Thanks in advance for any assistance you can offer.

Daniel

Dual 1GHz G4 PM and 15" MacBook Pro, Mac OS X (10.4.10)

Posted on Sep 26, 2007 2:14 AM

Reply

Answer 1

Sep 26, 2007 4:55 AM in response to Daniel Kiechle

What a mess! For starters, assuming you do actually have enough space available on disk (which you haven’t mentioned), the index corruption could be related to some filesystem corruption that should have been fixed first.

Second, when re-creating com.apple.mail.plist, you shouldn’t import anything. You should just enter the account information and Mail will automagically rediscover the data in ~/Library/Mail/ when done.

Third, importing as Other is meant for mailboxes in standard mbox format. Mail 2.x no longer uses that format. The mbox files you were trying to import are files that Mail 2.x leaves there after the conversion from Mail 1.x.

Verify/repair the startup disk (not just permissions), as described here:

The Repair functions of Disk Utility: what's it all about?

What’s the capacity and space available on the startup disk?

Reply

Answer 2

Sep 26, 2007 6:05 AM in response to David Gimeno Gost

Thanks for your reply. To take your points in sequence:

First, I have between 40 and 50 gigs left on my disk, so that is definitely not an issue.

Second, When I removed the preference file (com.apple.mail.plist), I also removed the folder "Mail" so as to start from scratch completely. Consequently, I had to import since there was nothing there. I am by now convinced that there is at least one corrupted item in one of my mailboxes (probably "Sent"), so just recreating the account and letting Mail rediscover the items is not going to do it. Still, I will give it a chance when I am home tonight.

Third, I only use "Other" because I read in one of Apple's notes that one should try "Other" in the event that the OS X Mail import failed (which it did). What you say about mail no longer using the mbox format is very interesting. It begs the question whether there is a way to actually export the contents of a mailbox as individual items that can then be reimported. It also explains why the import only brought in 5,200 items instead of the 7,900. The question is: where are the others?

Fourth, as I mentioned above, I used disk utility to check the disk and fix permissions, so I did not just do the permissions stuff. In my experience, if checking the disk gives you an OK result, then there is no point in booting from another disk to perform a repair disk. That's only needed when the check disk utility finds one or more faults. Am I in error on this? In any event, I've made so many copies of my mail folder (which is almost 2 gigs in size) that I doubt that I have a single byte in the same place it originally was, so I don't really believe there's anything from with my hardware.

So... is there any way to get to the individual items in a mailbox? Also, if the mbox files are no longer needed, can they be removed? Then again, forget it. One problem at a time!

Daniel

Reply

Answer 3

Sep 26, 2007 6:33 AM in response to Daniel Kiechle

You’re welcome.

When I removed the preference file (com.apple.mail.plist), I also removed
the folder "Mail" so as to start from scratch completely.

Well, that’s not what you said in your first post...

I only use "Other" because I read in one of Apple's notes that one should
try "Other" in the event that the OS X Mail import failed (which it did).

This is wrong in the case of Mail 2.x. That has to be an old article. Could you please be more specific as to where exactly did you find it?

there is a way to actually export the contents of a mailbox as individual
items that can then be reimported.

Selected messages can be exported in standard mbox format by doing File > Save As in Mail and choosing Raw Message Source from the Format popup menu. Standard mbox files can be imported into most mail clients. In particular, they can be imported back into Mail doing File > Import Mailboxes and choosing Other as the data format. Using this format, however, would cause some status flags to be lost (e.g. whether a message has been replied to).

Locally stored mailboxes can be copied to the Desktop or anywhere else by just dragging them there from Mail itself (for server-stored IMAP mailboxes, copy the messages to locally stored “On My Mac” mailboxes in Mail first). These, however, are .mbox folders (not standard mbox files), where messages are stored in individual .emlx files that other mail clients don’t know or care about. They can be imported back into Mail doing File > Import Mailboxes and choosing Mail for Mac OS X as the data format.

It also explains why the import only brought in 5,200 items instead of the 7,900.
The question is: where are the others?

In the Messages folder.

as I mentioned above, I used disk utility to check the disk and fix permissions, so I did
not just do the permissions stuff. In my experience, if checking the disk gives you an
OK result, then there is no point in booting from another disk to perform a repair disk.

Right. I missed that part of your first post. Sorry.

if the mbox files are no longer needed, can they be removed?

Yes. The only items within a mailbox (i.e. within an .mbox or an .imapmbox folder) used by Mail 2.x are Info.plist and the Messages folder. Any other files you may see there are almost certainly Mail 1.x files that Mail 2.x leaves there after the conversion. This is poorly explained in Mac OS X 10.4 Mail: Some mailbox files used by Mac OS X 10.3 are not deleted after importing. The article only talks about mailboxes in ~/Library/Mail/Mailboxes/, but the same can also be said about mailboxes in “POP-”, “IMAP-”, or “Mac-” account folders.

As long as you keep a backup copy of the old files for a while (at least, until you’re sure everything was converted properly), they can safely be removed from the Mail folder. OnyX has a Cleaning > Misc > Temporary and obsolete items option for getting rid of all those files.

Note that if you see strangely-named Messages-T0x... folders, these aren’t old files from previous versions of Mail, but rather an indication that there is something amiss. More specifically, these are temporary folders created by Mail 2.x during an import or a reindexing process (e.g. rebuilding a mailbox) that Mail should have deleted when done. Their presence is a clear indication that something didn’t work as expected.

<hr>

Here’s the procedure I usually suggest to set up Mail again from scratch:

1. If you have a .Mac account and .Mac synchronization of Mail data is enabled either in Mail > Preferences > General or in System Preferences > .Mac, disable it before proceeding.

2. Quit Mail if it’s running.

3. In the Finder, go to ~/Library/. Move (not copy) the entire Mail folder out of there, to the Desktop.

4. In the Finder, go to ~/Library/Preferences/. Locate com.apple.mail.plist and move it to the Desktop.

5. Open Mail and set it up again from scratch. If given the option to import existing mailboxes or something like that, don’t. Just enter the account information and check that everything works fine.

6. You’ll have to re-configure all your settings in Mail > Preferences. For spam-related security reasons, the first thing you should do is go to Preferences > Viewing and disable Display remote images in HTML messages if it’s enabled.

7. If Mail works fine now and you had any messages stored in local mailboxes, do File > Import Mailboxes, choose Mail for Mac OS X as the data format, and follow the instructions to import your mail from the old Mail folder that’s now on the Desktop. Import the Mailboxes folder first, then each of the POP-username@mailserver account folders, if any.

8. If .Mac synchronization of Mail data was enabled at the beginning, enable it again, go to System Preferences > .Mac > Advanced, click Reset Sync Data, and choose the appropriate options to reset the Mail data stored on the .Mac server with the data locally stored on the computer, i.e. sync data must flow from the computer to the .Mac server.

As a result of doing the above, some messages may be duplicated. Andreas Amann’s Mail Scripts has a Remove Duplicates script that you may find useful.

If all is well and you don’t miss anything, the files on the Desktop can be deleted, although you may want to keep them for a while, just in case.

Note: For those not familiarized with the ~/ notation, it refers to the user’s home folder. You can easily locate any of the folders referred to in this post by copying the folder path here, doing Go > Go to Folder in the Finder, and pasting the folder path there.

Reply

Answer 4

Sep 26, 2007 3:22 PM in response to David Gimeno Gost

Thanks a million, David. Your instructions are exactly what I needed. I have now spent a bit of time re-creating all my accounts and I've also reset my other preferences. Now I need to import the mailboxes; I made a first attempt at that. As you know, the folders end up as sub-folders in a folder called "Import n"; I haven't had time to do much, but when I drag folders out of the import folder and into the main folder list, I think there is a problem. In some cases, I can no longer open the individual emails by double-clicking; the window does open, but with a message to the effect that the contents were not downloaded from the server yet and were therefore not available. This is puzzling because these are local mailboxes.

It's late now, but what I will try tomorrow evening is to manually create folders in the main list and then transfer the contents of the folders inside the Import-n folders by drag and drop. I can't quite figure out why some of the folders are silver-colored and some blue. Do you know?

Anyway, I now have an archived copy of a perfectly configured (but empty) Mail folder and a copy (plus backup) of my old Mail folder sitting on my desktop. That means I can play with this import stuff until everything works correctly.

Thanks again for your help; I'll report back after I finish this import business tomorrow.

Cheers,

Daniel

Reply

Answer 5

Sep 26, 2007 5:00 PM in response to Daniel Kiechle

You’re welcome.

when I drag folders out of the import folder and into the main folder list,
I think there is a problem.

Yes, this appears to be one of the multiple bugs & glitches that Mail has when reorganizing mailboxes:

Problem Importing & Moving Messages
Crazy problem moving nested folders

You should be able to fix the problem by just re-creating Envelope Index again after having reorganized your mailboxes. Be sure you keep a backup copy of your mail in case something else doesn’t work as expected, though.

I can't quite figure out why some of the folders are silver-colored and some blue.

Blue and white Mail folders explained

Reply

Answer 6

Sep 27, 2007 10:24 AM in response to David Gimeno Gost

David,

I can't believe how much time you have invested helping me with this; thank you! I just finished importing all my emails, and as described yesterday, I got that weird message. I removed the Envelope Index file and had Mail rebuild it -- presto! All the emails (well, all I checked, anyway) were there and could be opened. The rebuild did mess with a few read/unread flags, but that was quick to fix.

I disabled the network on my laptop after I loaded a copy of my original (i.e., "pre-surgery" problem Mail folder) on it, and then launched Mail. That way, I was able to compare the message count of every folder in my new Mail folder on my desktop with those in the old one on the laptop. Nothing was missing, but I ended up with half a dozen or so duplicate emails which I deleted.

The status now, as far as I can see, is that the problem has been solved. We went from "what a mess!" (your original diagnosis) to "Problem solved" in what seems to me record time; again, I can't thank you enough. If they don't already, Apple should pay you for your services on this board. And with this, I'm closing this question.

Cheers,

Daniel

Reply

Answer 7

Oct 9, 2007 3:50 AM in response to David Gimeno Gost

Just to say I've had the same frustrating 'home directory full' problem with Mail.app and your many posts about it have been very informative - this one seems finally to have fixed it. Thanks, David.

Reply