Disk Space Disappearing

I have a MacBook Pro as follows:


MacBook Pro (Retina, 15-inch, Early 2013)

2.7 GHz Intel Core i7

16 GB 1600 MHz DDR3

Intel HD Graphics 4000 1536 MB


I have 500GB of SSD and El Capitan just installed about one week ago. I have the latest update to 10.11.


User uploaded file


My storage looks like the above showing 95.34 GB free. But my disk space looks like this...


User uploaded file


Showing usage of 267.62 GB which should leave me with over 220 GB free.


My storage has been steadily reducing itself every day - several days ago I was at 180 GB free and today I'm at 95 GB free. None of the folders I have show any increase in storage. I have used Disk Wave to look more closely at my files and looked at invisible files but cannot find any that would account for this issue.


I have rebuilt my disk using disk utility first aid and Cocktail. All current versions. I have reset using the old ZAP PRAM routine.


Anyone have any insight into this issue?

MacBook Pro with Retina display, OS X El Capitan (10.11)

Posted on Oct 20, 2015 1:04 AM

Reply
44 replies

Oct 20, 2015 9:29 AM in response to R C-R

R C-R

thank you for your comments.


Time Machine - I'm using a network Time Capsule and that seems to be functioning. I don't see any indication that I might be backing up snapshots. I'm not terribly technical so I don't know where to look to verify that.


I am using a utility called DiskWave to show me all files and folders including invisible.

User uploaded file

You can see the four items at the bottom - as previously identified - the "System" seems to be inline with what I expected at 8.8GB, the Users seems correct for Movies (about 188GB) and then audio, photos, etc. Other seems to be something I cannot identify. It is growing and is larger this morning than it was last night.

User uploaded file

I don't see any invisible files that are large enough to be the missing 100GB. But as you said earlier perhaps these are files that will not allow me to see their size?


Reminder - this is El Capitan we're looking at.

Oct 20, 2015 2:28 PM in response to R C-R

RC

Thanks for the insight.


I did go to /private/var and looked around. some of the folders in that area are not locked and I looked at folder dated within the last week because that's when this started to happen. Many of those are not locked and I could look over their size and contents.


db - about 2GB and inside the biggest folder was systemstats - a process that runs and collects system status data for apple.It has a 1GB file "snapshots." I looked in Activity Monitor and that process is not moving the most data. Actually mds_stores is moving close to a GB - that's the process that serves Spotlight and indexes files.


vm - about 1GB and inside is a "sleep image" - I take it that's for Time Machine.


But still none of this helps me find 130GB (I'm now up to that figure missing) - these are all small potatoes compared to what I'm looking for.


But then of course there's your suggestion - that these files are hidden and cannot be detected - they're the folders with the red badge on them but these don't have current dates which makes me suspect they're not the ones.

User uploaded file


The entire VAR folder shows up as 3.99GB. Nothing else in the PRIVATE folder shows up with a current date and none have red badges.

Oct 21, 2015 12:45 AM in response to Sorcerer2006

As a follow-on to further illustrate what's happening, I deleted some movies - about 10GB - from my SSD and here is the result.


User uploaded file

The Movies decreased by about 10GB as expected, however, the Other category increased so that my net available space didn't increase - remained at about 93GB. This is remarkably just under 20% - Time Machine stops generating snapshots and starts deleting files when the SSD gets to 20% availability. But as soon as I drop my storage below that lines, Time Machine takes over and starts using my SSD for it's own purposes. The space used by Time Machine is more or less invisible as it is located at /Volumes/MobilBackups - a space on the SSD that doesn't show up except as Other.


I'm going to be securing more evidence but I'm fairly certain that the evidence will establish that the structure of the operating system and utilization by one or more sub-routines such as time machine will ensure that everyone's SSD will always fill up within 20% or greater. This creates the impression that the user is running out of space and creates a need to find or purchase more storage.


My son has a MBP setup the same way with the 500GB SSD and his other has already creeped to way over 300GB while his movies and audio are much smaller. He's been looking for a solution because he is showing less than 10% available space.

Oct 21, 2015 10:35 AM in response to Sorcerer2006

We don't seem to be closing on a theory that would solve my problem.


So far, RC seems to be saying - the space is there but you just can't see it. it's taken up by temporary files that will make room for more if needed. And it's not Time Machine because the files that show up in MobilBackups are simply links and don't take up significant space.


I have proven the problem by removing 10GB of Movies and watching the OTHER increase to show that I still have only 92GB of available space. In theory I could remove 50GB more and the OTHER might take up that space - this is the case for my sons MBP where OTHER is 350GB and he can only find 100GB.

User uploaded file

And I have shown that I have about 130GB unaccounted for by showing my current SSD usage.

User uploaded file


So there is approximately 130GB of OTHER not showing on this picture but showing up above as not available.


Should I believe that if I were to try to transfer 200GB of new files to my drive, it would magically free up the space? I haven't use a computer like that before - it would certainly be a surprise if it did that but I have my doubts of success.


Here is a summary of actions taken:

- I have rebuilt Spotlight

- I have run Cocktail and rebuilt or removed systems caches, logs, temp files, etc.

- I have mapped my drive using DiskWave, Grand Perspective, Omni Disk Sweeper, and Supaview

- I have removed iCloud from my Time Machine backup volumes - TM now ignores iCloud

- I have rebooted on the Recovery Internet and run disk utilities

- I have moved files to iCloud to test the impact on this issue

- I have looked into Activity Monitor and quit any processes like SystemStats that was using significant disk space

- I have restarted the MBP and done the equivalent of a ZAP PRAM operation

- I have disabled Contacts and Calendar - disconnected them from iCloud and deleted their storage folder contents

- I have removed all foreign language support


Any other theories or recommended actions are welcome (I may have forgotten a few that I took and not recorded on my list)


It would appear that my next move should be to start over and either re-install OSX or completely wipe my SSD and restore from time machine - I should do a clean install of OSX but I'm not sure I know how to do all of that yet so I'll need to read something.

Oct 21, 2015 11:38 AM in response to Sorcerer2006

Here's a look at Grand Perspective's way of defining the space.

User uploaded file

Their free space of 86GB is a little under my About This Mac/Storage picture of 92GB. But they have a "Miscellaneous Used Space" category of 143GB (I had estimated 130GB earlier that I had lost) and their "Scanned Files" of 235GB is fairly close to my "Users" number of 230GB.


I am looking at the Disk Utilizes number of scanned files of 121M while this picture shows quit a few less.

Oct 22, 2015 8:42 AM in response to f104club

OK I went through this with Apple support and did all of the things that have been listed by everyone with no success.


Lastly I rebuilt the OSX from the recovery drive and that didn't work.


Now I just finished wiping the disk, building a new OSX, and using migration assistant to restore all my files from Time Machine. and it appears this has fixed the problem although we have to wait for a day or two to see if the available storage starts to disappear again. Here is my current picture.

User uploaded file

When I started I had gotten down to 92GB available and it was still going down. I had removed 10GB of movies only to have Other increase that exact amount and take away the space. So now I have picked up over 130GB that weren't there before - you can look back at my posts earlier in this message stream.


Now Apple had me delete a lot of files manually that were temp and cache files in the system, but that didn't work. I also uses Cocktail which is very good at removing temporary or cached files from the system but that didn't work. So I was never able to get rid of the files you mentioned although I have not tried Daisy Disk but I gave earlier a list of all the disk utilities I used but none of them would show me any files in that /private/var area so I never got the opportunity to delete them.


Replacing the entire drive is the most drastic measure on my list and I'm still not certain about the outcome - restoring from time capsule is an overnight process at best so it takes 8-10 hours even when you have a gigabit wireless. Not the easiest solution but certainly the "final" solution.


If this comes back, then I'm going to say we have a bug in how El Capitan handles files. If it does not, then I'll say that there is a problem with existing file structures when upgrading to 10.11.

Dec 7, 2015 3:35 PM in response to Sorcerer2006

Thank you for patiently taking us through the issues you were having. All of this sounds so eerily familiar to me I've also begun searching for a solution to what sounds like the same problem you had.


I am a designer who manages large print files (packaging, etc) on my MacBook. A few weeks ago I noticed I was nearing half my HD space, so I began to manually backup projects onto an external. I had the exact same problem you did... removing files did not clear up HD space. In the meantime I am now down to only 50G free and have 290G of "Other" because I think my attempt to clean up HD space has made this problem worse. The only thing I have done in addition is to turn off time capsule AND wipe local backups through a command window. That took my "Other" space down from 336G to 290G but strangely didn't free up any more room.


User uploaded file


I got to the point this afternoon where I can no longer expand large zip files and I am out of HD space. I have done nearly every step you attempted in October to try and fix this but I'm afraid my next step is wiping my HD.


Has anyone developed any additional solutions since October?

Jul 20, 2016 5:30 AM in response to Sorcerer2006

HEY I FOUND THE ANSWER!!!!


It's apples new versioning system. If you have any apps using that, it will eat up all your harddrive space. I just free'd up over 150 gigs!


Check out this article:

https://goo.gl/G4lKYK


And the solution from the comments here:

https://goo.gl/38T2iw


Would be nice if apple would make this more obvious and even nicer if they would allow us to set the versioning location to an external drive. However, as long as you use dropbox or something like that you dont need the versioning system anyway.


Extra bonus: That data also takes up space from your iOS devices since its all linked to icloud. After fixing this, back up your iphone to itunes, erase all its content and settings, then restore. Youll see more space on your device 🙂



Here's what my storage looks like now 😀

User uploaded file

Oct 20, 2015 2:57 PM in response to Sorcerer2006

vm - about 1GB and inside is a "sleep image" - I take it that's for Time Machine.

No, the sleepimage file is a snapshot of the contents of memory (RAM), used with the 'safesleep' hibernate feature when a Mac has to kill power to RAM during sleep. If you are interested, the pmset man page has some info about that (but don't get your hopes up about disabling it -- the commands to do that don't seem to work with recent Mac models -- apparently it has something to do with autopoweroff & the "implementation of Lot 6 to the European Energy-related Products Directive").


You also should be seeing one or more 'swapfiles' in /private/var/vm/. These are where virtual memory (paged out chunks of RAM) are stored. They vary in size & number depending on the amount of RAM installed & how much data needs to be paged out.

Oct 21, 2015 2:31 AM in response to Sorcerer2006

A few things to consider:


• From the What are Local Snapshots link Old Toad provided, note the following (emphasis added) ...


Unlike "normal" Time Machine backups to an external volume, Local Snapshots are not extra copies of a file.


... and the several places that say "nothing in the size column is meaningful" regarding the MobileBackups folder. It means exactly what it says -- any size data you see there should be disregarded because it may include space used by files that actually are stored elsewhere. Also note that it says "You'll see the same structure as for Time Machine backups on a separate volume ..." That structure does not use disk space the way it appears to in Finder. That is because it uses hard links to save space. For a detailed discussion of how that works (& why you can't just add up the space used by each time stamped backup to get anything meaningful) see How Time Machine Works its Magic from the same source.


• The Volumes folder is not really a folder in the normal sense. It is the mount point for all attached (mounted) volumes other than the startup volume. (You can see this in Disk Utility by selecting a volume on a mounted external drive. Look at the info in the first line at bottom of the window where it says "Mount Point.") By convention, the startup drive (usually named Macintosh HD) will appear there as well, although its actual mount point is "/" -- the root level of the directory structure. Note that a Finder display of /Volumes will show the startup drive listed as an alias & its size to be one byte.


So basically, nothing you see in /Volumes accurately represents space used on your startup volume. Any assumptions you make based on that will be wrong.


• As explained in About Time Machine local snapshots - Apple Support Time Machine creates and retains local snapshots only when there is plenty of free space on your startup drive. They will be deleted as needed when that space is needed by something else -- in that sense they are just temporary files. Even when there is adequate space they will be consolidated over time such that you will end up with only one snapshot per day (not one for every hourly local backup) & just one weekly snapshot is saved over the longer term. Also remember from the above that the actual size of these snapshots is not what it appears to be.


• From the same Apple article, note that Finder and Get Info windows do not include the space used by local snapshots in their calculations. To see the space they use, refer to the About This Mac > Storage or Disk Utility graphic display of the space used on the selected drive. The purple "Backups" section of the storage bar shows that space graphically & the text below it displays its numeric size. From your first screen shot, at that time local snapshots were using only about 90 MB, so they are not using significant amounts of space on the startup drive.


•• As a general observation, & with no disrespect intended, you are worrying about things that you do not understand very well, in large part because they are much more complicated than they seem (which is why they are normally hidden). Unless you are seeing some issue that points to inadequate free space on your startup drive as its cause, my advice is to quit worrying about how much space is being used.

Oct 21, 2015 12:28 PM in response to Sorcerer2006

Sorcerer2006 wrote:

... but I believe that users should be able to manage their space by adjusting the size and selection of files they choose to store on their hard drive. And I believe they should have tools that can tell them how much available space they have without any hocus-pocus.

You can adjust the selection of files you store on the drive, but not the files that the system stores there, at least not without running the considerable risk of breaking something that can cause serious problems, up to & including data loss or the inability to boot the system normally. It is a very complex OS, with many processes that require considerable study just to understand what they do, much less how or why they do it. In fact, some processes are reserved for the exclusive use of the system's many non-human users, & provide services essential to the normal functioning of the machine.


You are provided with all the tools needed to see how much disk space is available for your use -- that's what the graphics display like in your screen shots shows you. The display is straightforward, explicitly indicating the space used by certain specific types of files & lumping everything else into the "Other" section. Since there are literally dozens of different types of files that are or can be stored in both the user & system domains, it isn't practical (or for some things possible) to break things down further than that. As has been mentioned several times, some directories simply cannot even be read by regular or admin users, or altered or executed by any user other than the one non-human user that provides some low level system service. This is a major part of the security model of Unix & Unix-like systems, & in El Capitan it has been extended even further with the addition of so-called "rootless" System Integrity Protection, which denies write access to some files even by root.


If it helps, you can think of "Other" as "Everything Else," but you won't ever be able to see everything that includes without altering the fundamental way the OS works, at which point you will be on your own, without the support of Apple & taking full responsibility for the consequences of doing so.


As for any problems you might be having with the existing OS, aside from not understanding what is using some of the disk space, what specific problems are you actually seeing? Is the system sluggish, unstable, or anything like that? Do you see frequent application crashes or other error messages in the normal use of your Mac? If not, the only real problem is basically what you might call an intellectual one, which is why there has been so much focus on that.


For that, I suggest you consider browsing through the enormous amount of developer documentation Apple makes available at https://developer.apple.com/resources/ & possibly enrolling in the developer program. (Both free & paid accounts are available). I know of no better way to get insights into the "how & why" of the many facets of OS X.

Oct 20, 2015 3:03 AM in response to Sorcerer2006

As you may know by now, there are several more top level folders than the four shown in your second screen shot. The normally invisible ones will account for some of the difference in the total of those four vs. the overall total.


Beyond that, folders that you do not have at least read privileges for will always show "zero bytes" regardless of the size of their contents. (You can see this in Finder for example in the subfolders of /private/var -- you will find several folders marked with a red "no entry" badge, each of which will indicate "zero bytes" in Finder & return "permission denied" if you try to get their sizes with a Terminal "ls" command.) The same is true for any other user accounts you might have in /Users/ -- only the folders you have read access for will show their actual size.


This doesn't have anything directly to do with Spotlight -- it is just a consequence of the file system's permissions restrictions. However, About this Mac > Storage, Disk Utility's used/available info, Finder's "Get Info" for the drive itself, etc. will show you accurate aggregate totals because they get that info from the part of the file system that keeps track of used & unused space without regard for what it contains. So the info shown in your first screen shot is accurate, regardless of what adding up folder totals tells you.


As for the shrinking file space issue, that is most likely the result of what is known as "local snapshots," a Time Machine related feature enabled by default on laptop Macs that stores backup "snapshots" of the state of your startup drive locally on the drive itself until the laptop can access an external Time Machine backup drive. That is nothing to be concerned about because even if you don't use an external TM backup drive the OS will automatically purge the space those snapshots use if that space is needed for permanent file storage, like for your document files.

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

Disk Space Disappearing

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.