Level 1

55 points

mdworker crashes constantly; spotlight re-indexes

I have searched the internet and all communities trying to find a solution to my spotlight problem. I have posted in a couple of other forums and am re-posting here in a more organized fashion those posts plus additional information.

I recently moved my administrative user account over from an older mac via firewire/lightning connection, using the migration app. Since that time, my iMac, with the latest El Capitan update, has been continuously indexing. It takes hours (I transferred about 500Gb of files), then works OK for a brief period and then begins indexing again. I have moved my hard drive into the "privacy" portion of Spotlight prefs and back out, causing re-indexing. I have deleted the Spotlight index and had it re-index via Terminal, used disk utility to check my hard drive, used Onyx to rebuild permissions and re-index Spotlight. Spotlight takes a few hours to re-index, seems to work fine for a short time and then begins re-indexing and is not available for use once again. It has completely slowed my work to a crawl, since I use Spotlight continuously to retrieve and compare files and folders, as well as launch apps.

I noted on the crash logs that mds_stores is crashing and have had mdworker crash almost daily. SophosWebintelligence had also crashed on similar but not always the same days. I deleted Sophos anti-viral software, placed my hard drive into the "Privacy" section of Spotlight prefs to stop the continuous indexing, booted into safe mode, re-booted into my regular desktop, pulled my hard drive out of privacy settings, allowed Spotlight to AGAIN index my hard drive overnight and thought my problem was fixed. It lasted a day. It's now back to re-indexing and the crash logs show mds_stores crashed again, but now, while watching Console during indexing, mdworker is crashing mili-second by mili-second! Under user diagnostic reports, it lists mdworker_2016-06-(various times)_Dorks-iMac.crash over and over and under system diagnostic reports it lists mds_stores_2001-06-(various times)_Dorks-iMac.crash. I also noted this in the logs:

6/30/16 7:10:46.589 AM mdworker[9839]: WARNING: The Gestalt selector gestaltSystemVersion is returning 10.9.5 instead of 10.11.5. This is not a bug in Gestalt -- it is a documented limitation. Use NSProcessInfo's operatingSystemVersion property to get correct system version number.

Call location:

Not sure the above is the most relevant thing in the logs, but never had problems on my newer mac until I made the mistake of migrating my user account from my older mac. Not sure what NSProcessInfo is, but will research it.

If anyone has any suggestions, they would be very much appreciated. If any additional info would help, I'd be glad to get it. I didn't want to post too much useless stuff here and needlessly take up too much of your time. I apologize for the font changes, but couldn't figure out how to copy/paste while keeping same style.

Posted on Jun 30, 2016 8:46 AM

20 replies

Couchcowboy Author

Level 1

55 points

Jul 4, 2016 12:23 PM in response to Linc Davis

I finally used EasyFind to find the Spotlight-V100 folder and was able to delete the file by command clicking and moving to trash. I had to move a folder to the trash to be able to delete the trash (it was greyed out with just the Spotlight folder in it) and thereby delete the V100 folder. Spotlight then began to re-index and is currently working. I'm crossing my fingers since it usually works OK for a brief period, then starts re-indexing after an unknown trigger. I'll post again as soon as I've had time to see how stable things are going to be. Again, you have been an angel in disguise for me (and many others, obviously)! I'll try to repay you just a little by helping someone else out! Thanks!

Couchcowboy Author

Level 1

55 points

Jul 5, 2016 4:58 AM in response to Linc Davis

I'm sorry to report that this morning, Spotlight is once again re-indexing. I'm going to have to try something more radical I suppose. Another thing I've noticed that is very odd is that I don't have a Spotlight preference pane in system preferences on my administrative account that is NOT the one that is the problem! I have a Spotlight preference in a non-administrative account and in the current problem administrative account, but not in the one administrative non-problem one. Searching for spotlight in that non-problem one highlights the keyboard preference pane where Spotlight keyboard shortcuts prefs are, but you can click on Spotlight shortcuts in the search pane and it opens the Spotlight preferences???? Bizarre. Any ideas on that one?

Linc Davis

Level 10

209,739 points

Jul 6, 2016 5:56 AM in response to Couchcowboy

As a test, please temporarily add your home folder to the Privacy list in the Spotlight preference pane. That will exclude your personal files from being indexed. See whether indexing completes. Then remove the exclusion and see what happens.

Couchcowboy Author

Level 1

55 points

Jul 7, 2016 11:50 AM in response to Couchcowboy

While my fingers, toes and eyes are all crossed, I'm still holding my breath and still saying my prayers, I have now had a stable Spotlight for over 48 hrs and wanted to thank Linc Davis and Eric Root for their great help! I wanted to outline the final steps I took to solve my situation. This solution is probably only relevant for someone like myself who made the mistake of migrating a user account using Migration Assistant to a newer iMac from an older iMac, since that's when all my problems started. Here are the steps (in addition to the steps outlined by Linc and Eric that I had already performed; also, I had already move my Macintosh Hd into the privacy setting in Spotlight to stop the indexing):

1) Back up all critical data such as photos, movies, music, documents, etc. Back up to multiple places.

2) Move said data to the Shared user account. This keeps from having to transfer zillions of files from an external drive or remote source back to the account you're reconstructing.

3) Delete problem user account via System Preferences/Users & Groups. I also had to manually delete the problem user account folder since it remained on Macintosh HD after deleting via Users prefs (for some reason that I do not understand, upon deleting the problem user account from a separate administrative user account, it did not give me the three options it's supposed to give, i.e., "Keep home folder of user", etc???)

4) Delete the .Spotlight-V100 folder as outlined by Linc Davis here and elsewhere.

5) Re-create the just deleted user account, using the same user name. Check the "new" account to be sure it works OK.

6) Move the user data back from Shared to this "new" user account.

7) Move Macintosh HD (or whatever your hard drive is called) out of privacy setting in Spotlight prefs to re-start indexing.

8) Take a break; come out of your cave you've been dwelling in for the past few days trying to get this problem resolved. Depending upon how much data is on your computer, re-indexing may take awhile.

9) Check and see if Spotlight is working. Make a list of any file additions or changes you make for the next couple of days in case things go cross ways again and you have to try to figure out what you did or what you may need to do additional backup of. (I didn't want to do a full back up to my two primary back up sources until I was sure everything was working OK.)

10) Once you're sure everything's working, back up everything again.

If Linc or Eric review this and feel any of this is a problem, please add or subtract anything deemed dangerous!

Couchcowboy Author

Level 1

55 points

Jul 15, 2016 3:54 PM in response to Linc Davis

In contrast to my last note, moving my data and recreating my user account DID NOT solve my problem! Spotlight remained stable for about three days after I moved my data to "Shared", deleted and then re-added my account (see my last note immediately adjacent to this one to see all that I did). First, Spotlight started to freeze mid search, the Spotlight window freezing mid screen while everything else worked fine. I would have to use Activity Monitor to end Spotlight processes to close it's window. First, it would work OK, but then started freezing more often, until finally it started indexing again and again and again. Since all my problems started when I tried to switch from my seven year old mac to this four year old mac, I tried to reverse everything I did during that switch over, plus a few other things I thought of or read about. They include:

1) detached all peripherals (an extra monitor, a printer and a scanner). Only my mouse, keyboard and wireless trackpad are in use.

2) Using Onyx, rebuilt permissions, deleted all caches

3) Deleted Spotlight.prefs

4) Again deleted Spotlight-V100 folder, which I've done multiple times

5) Rebooted in Safe mode, which I've done multiple times

6) Stopped all auto login apps

7) Deleted some duplicate files in different user accounts

8) Moved my suspect account home folder into Privacy setting in Spotlight prefs, started using another admin user account for a while, only to have Spotlight lock up in it, with Console giving similar info such as "XPC connection was invalidated". Going back in to suspect user account, Spotlight began indexing again. I again moved my Hard Drive into Privacy setting in Spotlight to shut it off.

I'm praying that you're still monitoring replies, so below is Step 1 on the most recent crash. Step 2 is posted on Pastebin at http://pastebin.com/g9zquFi5

Indexing and searching disabled.

2016-07-15 17:02:28.910 mdimport[2497:687743] Paths: id(502) (

"/Library/Spotlight/iBooksAuthor.mdimporter",

"/Library/Spotlight/iWork.mdimporter",

"/Library/Spotlight/Microsoft Office.mdimporter",

"/System/Library/Spotlight/Application.mdimporter",

"/System/Library/Spotlight/Archives.mdimporter",

"/System/Library/Spotlight/Audio.mdimporter",

"/System/Library/Spotlight/Automator.mdimporter",

"/System/Library/Spotlight/Bookmarks.mdimporter",

"/System/Library/Spotlight/Chat.mdimporter",

"/System/Library/Spotlight/CoreMedia.mdimporter",

"/System/Library/Spotlight/Font.mdimporter",

"/System/Library/Spotlight/iCal.mdimporter",

"/System/Library/Spotlight/Image.mdimporter",

"/System/Library/Spotlight/iPhoto.mdimporter",

"/System/Library/Spotlight/iPhoto8.mdimporter",

"/System/Library/Spotlight/Mail.mdimporter",

"/System/Library/Spotlight/MIDI.mdimporter",

"/System/Library/Spotlight/Notes.mdimporter",

"/System/Library/Spotlight/PDF.mdimporter",

"/System/Library/Spotlight/PS.mdimporter",

"/System/Library/Spotlight/QuartzComposer.mdimporter",

"/System/Library/Spotlight/RichText.mdimporter",

"/System/Library/Spotlight/SystemPrefs.mdimporter",

"/System/Library/Spotlight/vCard.mdimporter",

"/Applications/Corel Painter 12/Corel Painter 12.app/Contents/Library/Spotlight/Corel Painter.mdimporter",

"/Applications/Evernote.app/Contents/Library/Spotlight/EvernoteSpotlightImporte r.mdimporter",

"/Applications/GarageBand.app/Contents/Library/Spotlight/GBSpotlightImporter.md importer",

"/Applications/Pixelmator.app/Contents/Library/Spotlight/Pixelmator.mdimporter"

)

kATSFontTestSeverityFatalError

kATSFontTestSeverityFatalError,

kATSFontTestSeverityInformation,

kATSFontTestSeverityMajorError,

kATSFontTestSeverityMinorError

kATSFontTestSeverityTechnicalError,

)".

(Import.Normal:1294) Using too many resources after 2112 files (wired: 0 resident: 899525 swapped: 0 regions: 1320), hit usage threshold importing /Users/(USER REDACTED)/Library/Containers/com.apple.iChat/Data/Library/Messages/Archive/2014 -07-22/(USER 2 REDACTED) on 2014-07-22 at 09.56.00.ichat, exiting to clean up now.

(Import.Normal:1294) Using too many resources after 2176 files (wired: 0 resident: 898901 swapped: 0 regions: 1330), hit usage threshold importing /Users/(USER REDACTED)/Library/Containers/com.apple.mail/Data/Library/Mail Downloads/71F36864-69B0-4568-8009-76763F5D0840/Howard 50th Anniversary Photo.PDF, exiting to clean up now.

(Import.Normal:1294) Using too many resources after 64 files (wired: 0 resident: 890051 swapped: 0 regions: 1180), hit usage threshold importing /Users/(USER 3 REDACTED)/Downloads/games/com.mojang/minecraftWorlds/Time Bomb/db/000036.ldb, exiting to clean up now.

(Server.Warning:445) No stores registered for metascope "kMDQueryScopeComputer"

(Server.Warning:445) No stores registered for metascope "kMDQueryScopeComputerIndexed"

FontImporter: Validation Result - "(

FontImporter: Validation failed - "/Users/(USER REDACTED)/Downloads/Fonts to Install/All Fonts/Holiday Pi/HolidayPi BT".

FontImporter: Validation failed - "/Users/(USER REDACTED)/Downloads/Fonts to Install/All Fonts/John Handy LET/John Handy LET Fonts".

FontImporter: Validation failed - "/Users/(USER REDACTED)/Downloads/Fonts to Install/All Fonts/Monkeyboy/Monkeyboy".

FontImporter: Validation failed - "/Users/(USER REDACTED)/Downloads/Fonts to Install/All Fonts/Ruach LET Fonts".

FontImporter: Validation failed - "/Users/(USER REDACTED)/Downloads/Fonts to Install/All Fonts/Telegram LET/Telegram LET Fonts".

FontImporter: Validation failed - "/Users/(USER REDACTED)/Downloads/Fonts to Install/All Fonts/Twelve Ton Sushi/Twelve Ton Sushi".

FontImporter: Validation failed - "/Users/(USER REDACTED)/Downloads/Fonts to Install/All Fonts/Westwood LET/Westwood LET Fonts".

FontImporter: Validation failed - "/Users/(USER REDACTED)/Downloads/Installed Fonts/minor problems? NOT INSTALLED/Nightmare Before Christmas.ttf".

dnssd_clientstub ConnectToServer: connect() failed path:/var/run/mDNSResponder Socket:20 Err:-1 Errno:1 Operation not permitted

dnssd_clientstub ConnectToServer: connect() failed path:/var/run/mDNSResponder Socket:4 Err:-1 Errno:1 Operation not permitted

dnssd_clientstub ConnectToServer: connect()-> No of tries: 1

dnssd_clientstub ConnectToServer: connect()-> No of tries: 2

dnssd_clientstub ConnectToServer: connect()-> No of tries: 3

mdworker(2213) deny file-read-data /private/var/folders/kp/hpws012n7mb5mfxtb856bxk40000gn/C/com.apple.scriptmanage r2.le.cache (import fstype:hfs fsflag:480D000 flags:40000005E diag:0 isXCode:0 uti:public.plain-text plugin:/Library/Spotlight/RichText.mdimporter - find suspect file using: sudo mdutil -t 1504140)

mdworker(2351) deny file-read-data /Applications/App Store.app (pre-plugin fstype:hfs fsflag:480D000 flags:40000005E diag:0 isXCode:0 uti:com.apple.disk-image-udif plugin:internalPlainTextImporter - find suspect file using: sudo mdutil -t 10032595)

mdworker(2351) deny file-read-data /Applications/App Store.app/Contents (pre-plugin fstype:hfs fsflag:480D000 flags:40000005E diag:0 isXCode:0 uti:com.apple.disk-image-udif plugin:internalPlainTextImporter - find suspect file using: sudo mdutil -t 10032595)

mdworker(2351) deny file-read-data /Applications/App Store.app/Contents/MacOS/App Store (pre-plugin fstype:hfs fsflag:480D000 flags:40000005E diag:0 isXCode:0 uti:com.apple.disk-image-udif plugin:internalPlainTextImporter - find suspect file using: sudo mdutil -t 10032595)

mdworker(2351) deny file-read-data /Applications/App Store.app/Contents/MacOS/App Store/..namedfork/rsrc (pre-plugin fstype:hfs fsflag:480D000 flags:40000005E diag:0 isXCode:0 uti:com.apple.disk-image-udif plugin:internalPlainTextImporter - find suspect file using: sudo mdutil -t 10032595)

mdworker(2351) deny file-read-data /Users/(USER 3 REDACTED)/Library/Preferences/com.apple.LaunchServices/com.apple.launchservices .secure.plist (pre-plugin fstype:hfs fsflag:480D000 flags:40000005E diag:0 isXCode:0 uti:com.apple.disk-image-udif plugin:internalPlainTextImporter - find suspect file using: sudo mdutil -t 10032595)

mdworker(2351) deny file-read-data /private/var/folders/9l/7b6dw9_s3qggf5zxgzhb151c0000gr/0/com.apple.LaunchServic es-134504.csstore (pre-plugin fstype:hfs fsflag:480D000 flags:40000005E diag:0 isXCode:0 uti:com.apple.disk-image-udif plugin:internalPlainTextImporter - find suspect file using: sudo mdutil -t 10032595)

tcp_connection_host_start 47 DNSServiceCreateConnection failed: -65563

tcp_connection_host_start 48 DNSServiceCreateConnection failed: -65563

tcp_connection_register_with_helper 47 net_helper_connection_start failed

tcp_connection_register_with_helper 48 net_helper_connection_start failed

If you have any other suggestions, I would greatly appreciate them and would try most anything. I am very handicapped in my work right now because of this.

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

mdworker crashes constantly; spotlight re-indexes