Looks like no one’s replied in a while. To start the conversation again, simply ask a new question.

Spotlight search keeps reindexing and not working

Hi there:


Long story short; Any idea at all why spotlight keeps reindeing, crashes and never finishes?


Background & Symptom:

Since upgrading to Mavericks my Spotlight haven't been indexing and searching properly. My main issue is Mail App because I search there 30-50 times a day but I can see the symptom is also there with searching for Apps or files. I've tried absolutely everything, been Googling and been on chat and phone support with Apple (still have time left on my extra warranty) at least 20 times and must say its shown no results so far.


Detail:

I've got 2 drives in it - 1 HDD and 1 SSD - everything OS, Apps and Mail is on the main SSD drive and I've even tried to have spotlight just index that but to no avail.


It worked prior to the upgrade from Mountain Lion to Mavericks.


I can see in console that my mds_stores crashes constantly (which maybe explains the behaviour) - maybe ~20 times a day.


The main thread that crashes is "com.apple.metadata.spotlightindex" but there are a couple of others too rarely (MDSSecureStore and com.apple.libdispatch-manager)


The other thing they all have in common is this message:

Exception Type: EXC_BAD_ACCESS (SIGSEGV)


and 50% of the mds_stores crashes have this in common:

Exception Codes: KERN_INVALID_ADDRESS at 0x0000000100000001


Here's some of the things I've done (and some of them many times in various orders):

- Reinstalled OS X Mavericks bare and reinstall/repaired on top of the existing install

- Moved a lot of the IMAP mails into local folders

- Tried different user account

- Uninstalled all kinds of stuff on the machine in case anything of that was the culrit

- Spotlight reindexing (both by dragging my drive into the spotlight exclusion as well as via the command line mdutil commands etc)

- Turned off FileVault (had to in order to get into Safe Mode)

- Reset PRAM (Cmd+Option+R+P)

- Have repaired disk permissions

- Have rebooted in safe mode

- Have rebooted in Recovery console and run resetpasswd/resetpassword and fixed ACLs

- Tried disabling everything but my mails in spotlight (Mail App)

- Lots of other things...


Any ideas at all?? I had to write here because I've rn out of options and I have on faith that Apple can sort it out (its been more than a month of open support cases).


Thanks a lot even for any ideas you might have!!


Cheers,

Daniel

MacBook Pro, OS X Mavericks (10.9)

Posted on Dec 9, 2013 4:22 AM

Reply
39 replies

Dec 29, 2013 3:01 AM in response to Daniel_iversen

There was a theory that the latest OS X 10.9.1 update was going to fix the mail issues but it didn't. Still have the same issue and Apple does not have an idea on how to proceed.


I have found out I can run each of the following Terminal commands to see what Spotlight is indexing:


sudo opensnoop -n mdworker


OR:


sudo fs_usage -w -f filesys mdworker | egrep "open"


But I can't seem to find a good way to correlate that to the crash logs.


Anyone has any ideas on how to troubleshoot this issue of mail not indexing properly (continuing to reindex in an endless loop and crashing) or have seen anything similar?


Thanks,

Daniel

Dec 30, 2013 7:00 AM in response to Daniel_iversen

are you sure is it Mail?

I have verry simmilar simptoms, except different memory address

I'm running 10.9.1 and it happened after this update. Before was ok.


It was happened first time 17.12.13 (first mds_store_xxx_crash report), and if I remember afer actualisation.


I have some suspicious that could be SIMBL extension but it is only something else.

Maybe we can share our systemlogs. Unfortunately I'm not a geek in this mater.


regards

Lukasz

Dec 30, 2013 3:57 PM in response to Eric Root

here you are.


Hardware Information:

MacBook Air (13-inch, Mid 2011)

MacBook Air - model: MacBookAir4,2

1 1.7 GHz Intel Core i5 CPU: 2 cores

4 GB RAM


Video Information:

Intel HD Graphics 3000 - VRAM: 384 MB


Audio Plug-ins:

BluetoothAudioPlugIn: Version: 1.0 - SDK 10.9

AirPlay: Version: 1.9 - SDK 10.9

AppleAVBAudio: Version: 2.0.0 - SDK 10.9

iSightAudio: Version: 7.7.3 - SDK 10.9


Startup Items:

PACESupport: Path: /Library/StartupItems/PACESupport

WkSvMacX: Path: /Library/StartupItems/WkSvMacX


System Software:

OS X 10.9.1 (13B42) - Uptime: 0 days 13:30:23


Disk Information:

APPLE SSD SM256C disk0 : (251 GB)

EFI (disk0s1) <not mounted>: 209.7 MB

MacAir SSD (disk0s2) /: 250.14 GB (11.02 GB free)

Recovery HD (disk0s3) <not mounted>: 650 MB


USB Information:

Apple Inc. FaceTime Camera (Built-in)


Apple Inc. BRCM20702 Hub

Apple Inc. Bluetooth USB Host Controller


Apple Inc. Apple Internal Keyboard / Trackpad


Sunplus Innovation Technology. USB to Serial-ATA bridge 1 TB

EFI (disk1s1) <not mounted>: 209.7 MB

FatBoySlim (disk1s2) /Volumes/FatBoySlim: 999.86 GB (10.36 GB free)


Apple Internal Memory Card Reader


FireWire Information:


Thunderbolt Information:

Apple Inc. thunderbolt_bus


Kernel Extensions:

at.obdev.nke.LittleSnitch (4052 - SDK 10.8)

com.AmbrosiaSW.AudioSupport (4.1.2 - SDK 10.7)

com.globaldelight.driver.BoomDevice (1.1 - SDK 10.5)

com.protech.NoSleep (1.3.3 - SDK 10.8)

com.Ondesoft.driver.OndeAudioRecorderDevice (1.0.0 - OS X 10.7)

com.Cycling74.driver.Soundflower (1.5.1)

com.paceap.kext.pacesupport.snowleopard (5.8 - SDK 10.6)

org.pqrs.driver.KeyRemap4MacBook (9.2.0)


Problem System Launch Daemons:

[failed] com.apple.wdhelper.plist


Problem System Launch Agents:


Launch Daemons:

[loaded] at.obdev.littlesnitchd.plist

[loaded] com.adobe.fpsaud.plist

[loaded] com.adobe.SwitchBoard.plist

[loaded] com.ambrosiasw.ambrosiaaudiosupporthelper.daemon.plist

[not loaded] com.barebones.textwrangler.plist

[loaded] com.bjango.istatmenusdaemon.plist

[loaded] com.bombich.ccc.plist

[loaded] com.bresink.system.securityagent.plist

[loaded] com.dervishsoftware.MailHubInstallerHelper.plist

[loaded] com.marketcircle.daylite.accessd.plist

[loaded] com.marketcircle.daylite.attachmentd.plist

[loaded] com.marketcircle.daylite.backupd.plist

[loaded] com.marketcircle.daylite.cardcald.plist

[loaded] com.marketcircle.daylite.dlbackup.plist

[loaded] com.marketcircle.daylite.dlconfigd.plist

[loaded] com.marketcircle.daylite.dlserver.plist

[loaded] com.marketcircle.daylite.portsd.plist

[loaded] com.marketcircle.daylite.staged.plist

[loaded] com.marketcircle.daylite.touchd.plist

[loaded] com.microsoft.office.licensing.helper.plist

[loaded] com.oracle.java.Helper-Tool.plist

[loaded] com.paceap.eden.licensed.plist

[loaded] org.pqrs.KeyRemap4MacBook.load.plist

[loaded] PACESupport.plist

[loaded] PPPMonitord.plist


Launch Agents:

[loaded] at.obdev.LittleSnitchUIAgent.plist

[not loaded] com.adobe.AAM.Updater-1.0.plist

[loaded] com.adobe.CS5ServiceManager.plist

[loaded] com.bjango.istatmenusagent.plist

[loaded] com.ecamm.iglasses3agent.plist

[loaded] com.oracle.java.Java-Updater.plist

[loaded] com.protech.NoSleep.plist

[loaded] com.wacom.pentablet.plist

[loaded] edu.vanderbilt.vuwer.plist

[loaded] net.culater.SIMBL.Agent.plist

[loaded] org.pqrs.KeyRemap4MacBook.server.plist

[loaded] SwapperUFi.plist


User Launch Agents:

[loaded] com.adobe.ARM.[...].plist

[loaded] com.dervishsoftware.MailHubUpdater.plist

[loaded] com.ecamm.printopia.plist

[loaded] com.google.keystone.agent.plist

[loaded] com.macpaw.CleanMyMac.helperTool.plist

[loaded] com.macpaw.CleanMyMac.trashSizeWatcher.plist

[loaded] com.macpaw.CleanMyMac.volumeWatcher.plist

[not loaded] com.marketcircle.daylite.dlbackuppersonal.plist

[loaded] com.marketcircle.daylite.pidclear.plist

[loaded] com.valvesoftware.steamclean.plist

[loaded] com.vladalexa.MagicPrefs.plist

[loaded] net.infinite-labs.SIMBLEnablerForSandboxedApps.plist

[not loaded] ws.agile.1PasswordAgent.plist


User Login Items:

iTunesHelper

CuteClips3

Calq

Cinch

Skype_2

PopChar

Typinator

DragonDrop

PastebotSync

Overflow

Dropbox

MagicMenu

Phone Amego

LazyMouseBG

Default Folder X Helper

Bartender

BambooCore


3rd Party Preference Panes:

Default Folder X

Flash Player

Flip4Mac WMV

Launchpad-Control

LazyMouse

MacFUSE

MagicPrefs

NoSleep

NTFS-3G

Pastebot Sync

Perian

Printopia

Spelling

SteerMouse

SwitchResX

PenTablet


Internet Plug-ins::

WacomNetscape: Version: 2.1.0-1 - SDK 10.8

Default Browser: Version: 537 - SDK 10.9

Flip4Mac WMV Plugin: Version: 2.4.2.4

WacomTabletPlugin: Version: WacomTabletPlugin 2.1.0.2

AdobeAAMDetect: Version: AdobeAAMDetect 1.0.0.0 - SDK 10.6

FlashPlayer-10.6: Version: 11.9.900.170 - SDK 10.6

AdobePDFViewerNPAPI: Version: 11.0.0 - SDK 10.6

Silverlight: Version: 5.1.20913.0 - SDK 10.6

Flash Player: Version: 11.9.900.170 - SDK 10.6

QuickTime Plugin: Version: 7.7.3

iPhotoPhotocast: Version: 7.0 - SDK 10.8

SharePointBrowserPlugin: Version: 14.3.9 - SDK 10.6

AdobePDFViewer: Version: 11.0.0 - SDK 10.6

GarminGpsControl: Version: 4.0.4.0 Release - SDK 10.6

JavaAppletPlugin: Version: 14.9.0 - SDK 10.7 Outdated! Update


User Internet Plug-ins::

Google Earth Web Plug-in: Version: 7.1


Bad Fonts:

None


Old applications:

None


Time Machine:

Skip System Files: NO

Mobile backups: ON

Auto backup: YES

Volumes being backed up:

MacAir SSD: Disk size: 232.96 GB Disk used: 222.70 GB

Destinations:

Air'owy czaso-cofacz [Local] (Last used)

Total size: 297.77 GB

Total number of backups: 28

Oldest backup: 2013-10-21 10:55:03 +0000

Last backup: 2013-12-20 14:39:20 +0000

Size of backup disk: Too small

Backup size 297.77 GB < (Disk used 222.70 GB X 3)

Time Machine details may not be accurate.

All volumes being backed up may not be listed.


Top Processes by CPU:

89% Mail

30% SecurityAgent

14% Finder

13% WindowServer

12% DFFinderWindowServer


Top Processes by Memory:

95 MB Finder

79 MB Mail

75 MB mds_stores

46 MB mdworker

37 MB WindowServer


Virtual Memory Statistics:

59 MB Free RAM

551 MB Active RAM

504 MB Inactive RAM

1.45 GB Wired RAM

18.87 GB Page-ins

728 MB Page-outs

Jan 1, 2014 6:21 AM in response to Eric Root

Hi there,


Thanks for the help. I've already uninstalled SIMBL in the past and that didn't help (its still uninstalled).


The report of running the tool is:


Hardware Information:

MacBook Pro (15-inch, Mid 2010)

MacBook Pro - model: MacBookPro6,2

1 2.66 GHz Intel Core i7 CPU: 2 cores

8 GB RAM


Video Information:

Intel HD Graphics - VRAM: 288 MB

NVIDIA GeForce GT 330M - VRAM: 512 MB


Audio Plug-ins:

BluetoothAudioPlugIn: Version: 1.0 - SDK 10.9

AirPlay: Version: 1.9 - SDK 10.9

AppleAVBAudio: Version: 2.0.0 - SDK 10.9

iSightAudio: Version: 7.7.3 - SDK 10.9


Startup Items:

CiscoVPN: Path: /System/Library/StartupItems/CiscoVPN


System Software:

OS X 10.9.1 (13B42) - Uptime: 1 day 4:28:56


Disk Information:

Hitachi HTS545050B9SA02 disk1 : (500.11 GB)

EFI (disk1s1) <not mounted>: 209.7 MB

HDD (disk1s2) /Volumes/HDD: 499.25 GB (107.66 GB free)


OWC Mercury EXTREME Pro 6G SSD disk0 : (120.03 GB)

EFI (disk0s1) <not mounted>: 209.7 MB

OWC SSD (disk0s2) /: 119.17 GB (16.31 GB free)

Recovery HD (disk0s3) <not mounted>: 650 MB


USB Information:

Apple Inc. Apple Internal Keyboard / Trackpad


Apple Inc. BRCM2070 Hub

Apple Inc. Bluetooth USB Host Controller


Apple Internal Memory Card Reader


Apple Inc. Built-in iSight


Apple Computer, Inc. IR Receiver


FireWire Information:


Thunderbolt Information:


Kernel Extensions:

org.virtualbox.kext.VBoxDrv (4.3.6)

org.virtualbox.kext.VBoxUSB (4.3.6)

org.virtualbox.kext.VBoxNetFlt (4.3.6)

org.virtualbox.kext.VBoxNetAdp (4.3.6)


Problem System Launch Daemons:


Problem System Launch Agents:


Launch Daemons:

[loaded] com.adobe.fpsaud.plist

[loaded] com.cisco.anyconnect.vpnagentd.plist

[loaded] com.crashplan.engine.plist

[loaded] com.fitbit.galileod.plist

[failed] com.livescribe.PenCommService.plist

[loaded] com.macpaw.CleanMyMac2.Agent.plist

[loaded] com.microsoft.office.licensing.helper.plist

[loaded] com.oracle.java.Helper-Tool.plist

[loaded] net.sourceforge.MonolingualHelper.plist

[not loaded] org.eyebeam.SelfControl.plist

[invalid] org.freedesktop.dbus-system.plist

[loaded] org.macosforge.xquartz.privileged_startx.plist

[invalid] org.macports.memcached.plist

[not loaded] org.virtualbox.startup.plist


Launch Agents:

[not loaded] com.adobe.AAM.Updater-1.0.plist

[loaded] com.cisco.anyconnect.gui.plist

[loaded] com.epson.esua.launcher.plist

[loaded] com.oracle.java.Java-Updater.plist

[invalid] org.freedesktop.dbus-session.plist

[loaded] org.macosforge.xquartz.startx.plist


User Launch Agents:

[loaded] com.adobe.AAM.Updater-1.0.plist

[loaded] com.crashplan.javacheck.plist

[not loaded] com.derman.syncem.userlauncher.plist

[loaded] com.google.keystone.agent.plist

[loaded] com.macpaw.CleanMyMac2Helper.diskSpaceWatcher.plist

[loaded] com.macpaw.CleanMyMac2Helper.scheduledScan.plist

[loaded] com.macpaw.CleanMyMac2Helper.trashWatcher.plist

[not loaded] org.virtualbox.vboxwebsrv.plist


User Login Items:

Flux

Flux

Quiet

GrowlHelperApp

Skype

Adium

PenAutoLaunch

AutoLaunchForConnect

Caffeine

Dropbox

CrashPlan menu bar

Fitbit Connect Menubar Helper

OpenDNS Updater

Path Finder


3rd Party Preference Panes:

TechTracker

Flash Player

Flip4Mac WMV

Growl

Java

MacFUSE

Perian


Internet Plug-ins::

o1dbrowserplugin: Version: 4.9.1.16010

Default Browser: Version: 537 - SDK 10.9

Flip4Mac WMV Plugin: Version: 3.2.0.16 - SDK 10.8

AdobeAAMDetect: Version: AdobeAAMDetect 2.0.0.0 - SDK 10.7

FlashPlayer-10.6: Version: 11.9.900.170 - SDK 10.6

Silverlight: Version: 5.1.20125.0 - SDK 10.6

Flash Player: Version: 11.9.900.170 - SDK 10.6

iPhotoPhotocast: Version: 7.0 - SDK 10.8

QuickTime Plugin: Version: 7.7.3

npgtpo3dautoplugin: Version: 0.1.44.29 - SDK 10.5

googletalkbrowserplugin: Version: 4.9.1.16010

SharePointBrowserPlugin: Version: 14.3.8 - SDK 10.6

JavaAppletPlugin: Version: Java 7 Update 45


User Internet Plug-ins::

WebEx64: Version: 1.0 - SDK 10.6

Picasa: Version: 1.0 - SDK 10.4

WebEx: Version: 1.0


Bad Fonts:

None


Old applications:

...

..(list of applications)..

...

..


Time Machine:

Skip System Files: NO

Mobile backups: OFF

Auto backup: YES

Volumes being backed up:

OWC SSD: Disk size: 110.99 GB Disk used: 95.80 GB

Destinations:

Seagate Backup Plus Drive [Local]

Total size: 3

Total number of backups: 12

Oldest backup: 2013-11-15 04:59:57 +0000

Last backup: 2013-12-11 11:36:32 +0000

Size of backup disk: Excellent

Backup size 3 > (Disk size 110.99 GB X 3)

AirPort Disk [Network] (Last used)

Total size: 1

Total number of backups: 28

Oldest backup: 2013-06-02 02:25:28 +0000

Last backup: 2013-12-13 13:55:03 +0000

Size of backup disk: Excellent

Backup size 1 > (Disk size 110.99 GB X 3)

Time Machine details may not be accurate.

All volumes being backed up may not be listed.


Top Processes by CPU:

9% WindowServer

5% Terminal

4% HP Device Monitor

3% firefox

3% EtreCheck


Top Processes by Memory:

336 MB firefox

213 MB java

131 MB Finder

115 MB PluginProcess

98 MB com.apple.WebKit.WebContent


Virtual Memory Statistics:

3.06 GB Free RAM

1.85 GB Active RAM

696 MB Inactive RAM

1.36 GB Wired RAM

3.36 GB Page-ins

139 MB Page-outs


Any ideas what I could try next or a hypothesis of what could be wrong?


Thanks a lot!


Cheers,

Daniel

Jan 1, 2014 8:37 AM in response to Daniel_iversen

Try un-installing CleanMyMac 2. By Thomas Reed, a frequent poster who specializes in malware.


Myth of the Dirty Mac


CleanMyMac2 Un-install



npgtpo3dautoplugin: Version: 0.1.44.29 - SDK 10.5



I would also go to the hard drive level Library/Internet Plugins and delete the above or update it. It isn't loading properly.


Picasa: Version: 1.0 - SDK 10.4


Go to Finder and select your user/home folder. With that Finder window as the front window, either select Finder/View/Show View options or go command - J. When the View options opens, check ’Show Library Folder’. That should make your user library folder visible in your user/home folder. Then go to Internet Plugins there and delete the above.


Thanks to leonie for some information contained in this.


[failed] com.livescribe.PenCommService.plist

[invalid] org.freedesktop.dbus-system.plist

[invalid] org.macports.memcached.plist

[not loaded] org.virtualbox.startup.plist

[not loaded] com.derman.syncem.userlauncher.plist

[not loaded] org.virtualbox.vboxwebsrv.plist


The programs associated with these need to be removed/updated.

Jan 2, 2014 4:28 AM in response to Daniel_iversen

Yes, configuration is this same as before update, even more, some of the apps was updated, so my conclusion is that only Apple system update cause this mess.

I have still my reports from console but as I said, I'm not a specialist in UNIX and I don't know how to read it preciesely and combine some entries with crashes.

I thing that it cause be gmail account because after update I get a lot off errors in log corresponding to the gmail, but it is only suspicious.

Jan 8, 2014 3:07 AM in response to Daniel_iversen

Similar problem here. 14 hours of spotlight indexing remaining. Could I have an unindexable file somewhere?


Process: mds_stores [10762]

Path: /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Metadat a.framework/Versions/A/Support/mds_stores

Identifier: mds_stores

Responsible: mds_stores [10762]

5 mds_stores 0x000000010531f47a 0x10531b000 + 17530

0x10531b000 - 0x105358fff mds_stores (800.19) <B1B7E731-D8C5-3FEF-AE75-C8E3E6A7F351> /System/Library/Frameworks/CoreServices.framework/Frameworks/Metadata.framework /Versions/A/Support/mds_stores

Jan 8, 2014 1:35 PM in response to Eric Root

I tried removing Clean My Mac 2 as well as npgtpo3dautoplugin, but it didn't help..


I did some casual monitoring of the various related unix processes and their file system activity (

sudo fs_usage -f filesys mds mdworker mdimport mds_stores) but didn't find much else than the times when the crash logs were created - but its way too hard to try and correlate it to the console logs because of the volume of data and what might be buffering/timing of activities.


Any other suggestions? This is driving me nuts (its probably been 3 months or so) and Apple support and engineering came back again and offered no other solution than trying to siftle through and sort/categorise the mails until I find some culprits - which obviously could take weeks with hundreds of thousands of mails and is just not practically possible.


Any help is appreciated and thanks in advance so far for all the great ideas and thoughts.


Cheers,

Daniel

Jan 8, 2014 3:17 PM in response to Daniel_iversen

also, I just ran the command "sudo opensnoop -v -e -n mds_stores >> mail-indexing-log.txt" to try a last time to see what was going on during the crashes but to no avail - I could see 2 "mds64-crash-state" messages (so maybe a small sample) but there's no mail-relates files that seem to be touched there (in 1 case there was a calendar file and the others just random files).


Lastly, I just ran Memtest as I read that the "EXC_BAD_ACCESS" message in the Console sometimes when "mds_stores" crashes can be memory related, but it found no errors (with 2 passes).


Any insights or thoughts would be appreciated..


Thanks in advance,

Daniel

Spotlight search keeps reindexing and not working

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple ID.