Daily, successive kernel panics - how to identify root issue?
A few weeks ago, my computer suffered from some water damage. I sent it to an Apple repair center where most of it was replaced, including the logic board, speakers, discrete GPU, and I/O board.
After using it for 2 days without issues, I installed OS X 10.9.4. Since then, I have had multiple, successive kernel panics every day. Strangely, these are not easy to reproduce; I can go 12 hours or more without having a problem. Then, in the middle of scrolling in Safari or opening an application like Preview, the graphics will glitch out and the system will crash. After one crash, further crashes can happen within seconds or minutes of a reboot.
Things I've tried with no luck:
- NVRAM reset
- SMC reset
- Apple Hardware Diagnostic
- verified the SSD with disk utility + repaired filesystem permissions from recovery mode
- Rember memory test
- memtest86 from a USB stick
- tried to induce crashes by stress-testing the discrete GPU
- unplug all peripherals (I have a mouse and headphones with an integrated microphone) - still get panics with them disconnected
Initially, I suspected that my Razer mouse drivers were to blame, but I've still been getting panics since removing all of my 3rd-party kernel extensions.
You can see all of my panics here: https://drive.google.com/folderview?id=0B6JO6Q_WYjb2TURkU1N5ZWprbTQ&usp=sharing
Lots of them relate to IOkit
This is the strangest panic:
Anonymous UUID: FFC394C8-E738-4D3C-C175-AA82009ED4C4
Fri Jul 11 11:19:59 2014
panic(cpu 0 caller 0xffffff80146dcad9): "Double fault at 0xffffff80146dba64, registers:\n" "CR0: 0x000000008001003b, CR2: 0xffffff8202c47e78, CR3: 0x0000000017099000, CR4: 0x00000000001606e0\n" "RAX: 0x0000000000000008, RBX: 0x000000000000000e, RCX: 0x0000000000000000, RDX: 0xffffff80146f3570\n" "RSP: 0xffffff8202c47e80, RBP: 0xffffff8202c48040, RSI: 0xffffff8202c48050, RDI: 0xffffff8202c48070\n" "R8: 0x0000000000000000, R9: 0x0000000000000000, R10: 0xffffff81d67f0da0, R11: 0x0000000000000440\n" "R12: 0xffffff8202c48060, R13: 0xffffff8202c48520, R14: 0xffffff8014645000, R15: 0xffffff8202c48070\n" "RFL: 0x0000000000010082, RIP: 0xffffff80146dba64, CS: 0x0000000000000008, SS: 0x0000000000000010\n" "Error code: 0x0000000000000000\n"@/SourceCache/xnu/xnu-2422.110.17/osfmk/i386/trap_native.c :168
Backtrace (CPU 0), Frame : Return Address
0xffffff81d67fcce0 : 0xffffff8014622f79
0xffffff81d67fcd60 : 0xffffff80146dcad9
0xffffff81d67fcec0 : 0xffffff80146f400f
0xffffff8202c48040 : 0xffffff80146f3746
0xffffff8202c48060 : 0xffffff801467811e
0xffffff8202c48320 : 0xffffff80146dbdd0
0xffffff8202c484f0 : 0xffffff80146f3746
0xffffff8202c48510 : 0xffffff801467811e
0xffffff8202c487d0 : 0xffffff80146dbdd0
0xffffff8202c489a0 : 0xffffff80146f3746
0xffffff8202c489c0 : 0xffffff801467811e
0xffffff8202c48c80 : 0xffffff80146dbdd0
0xffffff8202c48e50 : 0xffffff80146f3746
0xffffff8202c48e70 : 0xffffff801467811e
0xffffff8202c49130 : 0xffffff80146dbdd0
0xffffff8202c49300 : 0xffffff80146f3746
0xffffff8202c49320 : 0xffffff801467811e
0xffffff8202c495e0 : 0xffffff80146dbdd0
0xffffff8202c497b0 : 0xffffff80146f3746
0xffffff8202c497d0 : 0xffffff801467811e
0xffffff8202c49a90 : 0xffffff80146dbdd0
0xffffff8202c49c60 : 0xffffff80146f3746
0xffffff8202c49c80 : 0xffffff801467811e
0xffffff8202c49f40 : 0xffffff80146dbdd0
0xffffff8202c4a110 : 0xffffff80146f3746
0xffffff8202c4a130 : 0xffffff801467811e
0xffffff8202c4a3f0 : 0xffffff80146dbdd0
0xffffff8202c4a5c0 : 0xffffff80146f3746
0xffffff8202c4a5e0 : 0xffffff801467811e
0xffffff8202c4a8a0 : 0xffffff80146dbdd0
0xffffff8202c4aa70 : 0xffffff80146f3746
0xffffff8202c4aa90 : 0xffffff801467811e
0xffffff8202c4ad50 : 0xffffff80146dbdd0
0xffffff8202c4af20 : 0xffffff80146f3746
0xffffff8202c4af40 : 0xffffff801467811e
0xffffff8202c4b200 : 0xffffff80146dbdd0
0xffffff8202c4b3d0 : 0xffffff80146f3746
0xffffff8202c4b3f0 : 0xffffff801467811e
0xffffff8202c4b6b0 : 0xffffff80146dbdd0
0xffffff8202c4b880 : 0xffffff80146f3746
0xffffff8202c4b8a0 : 0xffffff801467811e
0xffffff8202c4bb60 : 0xffffff80146dbdd0
0xffffff8202c4bd30 : 0xffffff80146f3746
0xffffff8202c4bd50 : 0
And one of the most recent ones:
Anonymous UUID: FFC394C8-E738-4D3C-C175-AA82009ED4C4
Sun Jul 13 13:36:13 2014
panic(cpu 4 caller 0xffffff8019cdc24e): Kernel trap at 0xffffff7f9bcbda38, type 13=general protection, registers:
CR0: 0x0000000080010033, CR2: 0x0000000130e05000, CR3: 0x000000003010d030, CR4: 0x00000000001606e0
RAX: 0xffffff7f9bd79610, RBX: 0xffffff803f1d8f00, RCX: 0x0000000000017d45, RDX: 0xffffff803cfbc878
RSP: 0xffffff82194eb8a0, RBP: 0xffffff82194eb8b0, RSI: 0x0000000000000000, RDI: 0xffffff803f20e700
R8: 0x0000000000000191, R9: 0x0000000000000000, R10: 0xffffff803eaff2a4, R11: 0xffffff7f9bcc09ee
R12: 0x0000000000000040, R13: 0xffffff803e9e5101, R14: 0xffffff803d08c200, R15: 0xffffff8040bfa000
RFL: 0x0000000000010246, RIP: 0xffffff7f9bcbda38, CS: 0x0000000000000008, SS: 0x0000000000000010
Fault CR2: 0x0000000130e05000, Error code: 0x0000000000000000, Fault CPU: 0x4
Backtrace (CPU 4), Frame : Return Address
0xffffff81fbf15df0 : 0xffffff8019c22f79
0xffffff81fbf15e70 : 0xffffff8019cdc24e
0xffffff81fbf16040 : 0xffffff8019cf3746
0xffffff81fbf16060 : 0xffffff7f9bcbda38
0xffffff82194eb8b0 : 0xffffff7f9bd43afb
0xffffff82194eb8c0 : 0xffffff7f9bcd465c
0xffffff82194eb8f0 : 0xffffff7f9bcc35e3
0xffffff82194eb940 : 0xffffff7f9bd4232c
0xffffff82194eb980 : 0xffffff7f9bd3ce77
0xffffff82194eba20 : 0xffffff7f9bcc2824
0xffffff82194eba50 : 0xffffff7f9bcc2adb
0xffffff82194eba80 : 0xffffff7f9bcce638
0xffffff82194ebac0 : 0xffffff7f9bd41b41
0xffffff82194ebae0 : 0xffffff7f9bcc0bf5
0xffffff82194ebb70 : 0xffffff801a0cf9ca
0xffffff82194ebb90 : 0xffffff801a0d052e
0xffffff82194ebbf0 : 0xffffff801a0cdf7f
0xffffff82194ebd40 : 0xffffff8019cb6998
0xffffff82194ebe50 : 0xffffff8019c26bc1
0xffffff82194ebe80 : 0xffffff8019c139c5
0xffffff82194ebef0 : 0xffffff8019c1e013
0xffffff82194ebf70 : 0xffffff8019cc9b8d
0xffffff82194ebfb0 : 0xffffff8019cf3f66
Kernel Extensions in backtrace:
com.apple.iokit.IOAcceleratorFamily2(98.22)[0EC64777-94B9-32E3-AC03-A2367895744 B]@0xffffff7f9bcbb000->0xffffff7f9bd1ffff
dependency: com.apple.iokit.IOPCIFamily(2.9)[4662B11D-2ECA-315D-875C-618C97CDAB2A]@0xffffff 7f9a2be000
dependency: com.apple.iokit.IOGraphicsFamily(2.4.1)[75D81741-64C1-3941-ADFA-9D6B6C434EE4]@0 xffffff7f9a55b000
com.apple.driver.AppleInt<lHD5000=raphics>(8.2.8)[E2405B1B-94F0-3555-AE41-55B6D 27F1383]@0xffffff7f9bd24300->0xffffff7f9bd752ff
dependency: com.apple.iokit.IOSurface(91.1)[5E4EA3A2-5AB6-3577-B32D-EF5717A0EF5B]@0xffffff7 f9aeb9000
dependency: com.apple.iokit.IOPCIFamily(2.9)[4662B11D-2ECA-315D-875C-618C97CDAB2A]@0xffffff 7f9a2be000
dependency: com.apple.iokit.IOGraphicsFamily(2.4.1)[75D81741-64C1-3941-ADFA-9D6B6C434EE4]@0 xffffff7f9a55b000
dependency: com.apple.iokit.IOAcceleratorFamily2(98.22)[0EC64777-94B9-32E3-AC03-A2367895744 B]@0xffffff7f9bcbb000
BSD process name corresponding to current thread: WindowServer
Mac OS version:
13E28
Kernel version:
Darwin Kernel Version 13.3.0: Tue Jun 3 21:27:35 PDT 2014; root:xnu-2422.110.17~1/RELEASE_X86_64
Kernel UUID: BBFADD17-672B-35A2-9B7F-E4B12213E4B8
Kernel slide: 0x0000000019a00000
Kernel text base: 0xffffff8019c00000
System model name: MacBookPro11,3 (Mac-2BD1B31983FE1663)
System uptime in nanoseconds: 394778446532
last loaded kext at 243101241744: com.apple.filesystems.msdosfs 1.9 (addr 0xffffff7f9c233000, size 65536)
last unloaded kext at 113451959167: com.apple.driver.AppleFileSystemDriver 3.0.1 (addr 0xffffff7f9c12e000, size 8192)
loaded kexts:
com.apple.filesystems.msdosfs 1.9
com.apple.driver.AppleMikeyHIDDriver 124
com.apple.driver.AppleHWSensor 1.9.5d0
com.apple.filesystems.autofs 3.0
com.apple.iokit.IOBluetoothSerialManager 4.2.6f1
com.apple.driver.AudioAUUC 1.60
com.apple.driver.ApplePlatformEnabler 2.0.9d6
com.apple.driver.AGPM 100.14.28
com.apple.driver.X86PlatformShim 1.0.0
com.apple.filesystems.ntfs 3.11
com.apple.driver.AppleGraphicsDevicePolicy 3.6.22
com.apple.driver.AppleUpstreamUserClient 3.5.13
com.apple.driver.AppleHDA 2.6.3f4
com.apple.iokit.IOUserEthernet 1.0.0d1
com.apple.GeForce 8.2.6
com.apple.Dont_Steal_Mac_OS_X 7.0.0
com.apple.driver.AppleHWAccess 1
com.apple.iokit.BroadcomBluetoothHostControllerUSBTransport 4.2.6f1
com.apple.driver.AppleIntelHD5000Graphics 8.2.8
com.apple.driver.AppleCameraInterface 4.26.0
com.apple.driver.AppleThunderboltIP 1.1.2
com.apple.driver.AppleSMCLMU 2.0.4d1
com.apple.driver.AppleLPC 1.7.0
com.apple.driver.AppleIntelFramebufferAzul 8.2.8
com.apple.driver.AppleMuxControl 3.6.22
com.apple.driver.AppleMCCSControl 1.2.5
com.apple.driver.AppleUSBTCButtons 240.2
com.apple.driver.AppleUSBTCKeyboard 240.2
com.apple.driver.AppleUSBCardReader 3.4.1
com.apple.AppleFSCompression.AppleFSCompressionTypeDataless 1.0.0d1
com.apple.AppleFSCompression.AppleFSCompressionTypeLZVN 1.0.0d1
com.apple.AppleFSCompression.AppleFSCompressionTypeZlib 1.0.0d1
com.apple.BootCache 35
com.apple.driver.AppleUSBHub 683.4.0
com.apple.driver.XsanFilter 404
com.apple.iokit.IOAHCIBlockStorage 2.6.0
com.apple.driver.AppleAHCIPort 3.0.5
com.apple.driver.AirPort.Brcm4360 842.21.65
com.apple.driver.AppleUSBXHCI 683.4.0
com.apple.driver.AppleSmartBatteryManager 161.0.0
com.apple.driver.AppleRTC 2.0
com.apple.driver.AppleACPIButtons 2.0
com.apple.driver.AppleHPET 1.8
com.apple.driver.AppleSMBIOS 2.1
com.apple.driver.AppleACPIEC 2.0
com.apple.driver.AppleAPIC 1.7
com.apple.nke.applicationfirewall 153
com.apple.security.quarantine 3
com.apple.kext.triggers 1.0
com.apple.iokit.IOSerialFamily 10.0.7
com.apple.driver.DspFuncLib 2.6.3f4
com.apple.vecLib.kext 1.0.0
com.apple.iokit.IOAudioFamily 1.9.7fc2
com.apple.kext.OSvKernDSPLib 1.14
com.apple.iokit.IOAcceleratorFamily 98.22
com.apple.nvidia.driver.NVDAGK100Hal 8.2.6
com.apple.nvidia.driver.NVDAResman 8.2.6
com.apple.iokit.IOBluetoothFamily 4.2.6f1
com.apple.iokit.IOBluetoothHostControllerUSBTransport 4.2.6f1
com.apple.iokit.IOSurface 91.1
com.apple.driver.X86PlatformPlugin 1.0.0
com.apple.driver.AppleHDAController 2.6.3f4
com.apple.iokit.IOHDAFamily 2.6.3f4
com.apple.driver.AppleSMC 3.1.8
com.apple.driver.IOPlatformPluginFamily 5.7.1d6
com.apple.AppleGraphicsDeviceControl 3.6.22
com.apple.iokit.IOAcceleratorFamily2 98.22
com.apple.driver.AppleGraphicsControl 3.6.22
com.apple.driver.AppleBacklightExpert 1.0.4
com.apple.iokit.IONDRVSupport 2.4.1
com.apple.driver.AppleSMBusController 1.0.12d1
com.apple.iokit.IOGraphicsFamily 2.4.1
com.apple.driver.AppleUSBMultitouch 240.9
com.apple.iokit.IOUSBHIDDriver 660.4.0
com.apple.driver.AppleThunderboltDPInAdapter 3.1.7
com.apple.driver.AppleThunderboltDPAdapterFamily 3.1.7
com.apple.driver.AppleThunderboltPCIDownAdapter 1.4.5
com.apple.iokit.IOSCSIBlockCommandsDevice 3.6.6
com.apple.iokit.IOUSBMassStorageClass 3.6.0
com.apple.iokit.IOSCSIArchitectureModelFamily 3.6.6
com.apple.driver.AppleUSBMergeNub 650.4.0
com.apple.driver.AppleUSBComposite 656.4.1
com.apple.iokit.IOUSBUserClient 660.4.2
com.apple.iokit.IOAHCIFamily 2.6.5
com.apple.driver.AppleThunderboltNHI 2.0.1
com.apple.iokit.IOThunderboltFamily 3.3.1
com.apple.iokit.IO80211Family 640.36
com.apple.driver.mDNSOffloadUserClient 1.0.1b5
com.apple.iokit.IONetworkingFamily 3.2
com.apple.iokit.IOUSBFamily 683.4.0
com.apple.driver.AppleEFINVRAM 2.0
com.apple.driver.AppleEFIRuntime 2.0
com.apple.iokit.IOHIDFamily 2.0.0
com.apple.iokit.IOSMBusFamily 1.1
com.apple.security.sandbox 278.11.1
com.apple.kext.AppleMatch 1.0.0d1
com.apple.security.TMSafetyNet 7
com.apple.driver.AppleKeyStore 2
com.apple.driver.DiskImages 371.1
com.apple.iokit.IOStorageFamily 1.9
com.apple.iokit.IOReportFamily 23
com.apple.driver.AppleFDEKeyStore 28.30
com.apple.driver.AppleACPIPlatform 2.0
com.apple.iokit.IOPCIFamily 2.9
com.apple.iokit.IOACPIFamily 1.4
com.apple.kec.corecrypto 1.0
com.apple.kec.pthread 1
System Profile:
Model: MacBookPro11,3, BootROM MBP112.0138.B07, 4 processors, Intel Core i7, 2.6 GHz, 16 GB, SMC 2.19f7
Graphics: Intel Iris Pro, Intel Iris Pro, Built-In
Graphics: NVIDIA GeForce GT 750M, NVIDIA GeForce GT 750M, PCIe, 2048 MB
Memory Module: BANK 0/DIMM0, 8 GB, DDR3, 1600 MHz, 0x02FE, -
Memory Module: BANK 1/DIMM0, 8 GB, DDR3, 1600 MHz, 0x02FE, -
AirPort: spairport_wireless_card_type_airport_extreme (0x14E4, 0x134), Broadcom BCM43xx 1.0 (6.30.223.154.65)
Bluetooth: Version 4.2.6f1 14216, 3 services, 15 devices, 1 incoming serial ports
Network Service: Wi-Fi, AirPort, en0
Serial ATA Device: APPLE SSD SM1024F, 1 TB
USB Device: Internal Memory Card Reader
USB Device: Apple Internal Keyboard / Trackpad
USB Device: BRCM20702 Hub
USB Device: Bluetooth USB Host Controller
Thunderbolt Bus: MacBook Pro, Apple Inc., 17.1
My EtreCheck Report:
EtreCheck version: 1.9.12 (48)
Report generated July 13, 2014 at 2:03:56 PM EDT
Hardware Information:
MacBook Pro (Retina, 15-inch, Late 2013) (Verified)
MacBook Pro - model: MacBookPro11,3
1 2.6 GHz Intel Core i7 CPU: 4 cores
16 GB RAM
Video Information:
Intel Iris Pro - VRAM: (null)
Color LCD 2880 x 1800
NVIDIA GeForce GT 750M - VRAM: 2048 MB
System Software:
OS X 10.9.4 (13E28) - Uptime: 0 days 0:4:59
Disk Information:
APPLE SSD SM1024F disk0 : (1 TB)
EFI (disk0s1) <not mounted>: 209.7 MB
OS X SSD (disk0s2) / [Startup]: 699.7 GB (630.25 GB free)
Recovery HD (disk0s3) <not mounted>: 650 MB
disk0s4 (disk0s4) <not mounted>: 134.2 MB
BOOTCAMP (disk0s5) /Volumes/BOOTCAMP: 299.86 GB (149.15 GB free)
USB Information:
Apple Internal Memory Card Reader
Apple Inc. Apple Internal Keyboard / Trackpad
Apple Inc. BRCM20702 Hub
Apple Inc. Bluetooth USB Host Controller
Thunderbolt Information:
Apple Inc. thunderbolt_bus
Gatekeeper:
Mac App Store and identified developers
Launch Daemons:
[loaded] com.adobe.fpsaud.plist Support
[loaded] com.google.keystone.daemon.plist Support
Launch Agents:
[loaded] com.google.keystone.agent.plist Support
User Launch Agents:
[loaded] com.valvesoftware.steamclean.plist Support
User Login Items:
iTunesHelper
Flux
Steam
ShiftIt
Dropbox
Alfred 2
Internet Plug-ins:
FlashPlayer-10.6: Version: 14.0.0.145 - SDK 10.6 Support
QuickTime Plugin: Version: 7.7.3
Flash Player: Version: 14.0.0.145 - SDK 10.6 Support
Default Browser: Version: 537 - SDK 10.9
o1dbrowserplugin: Version: 5.4.2.18903 Support
googletalkbrowserplugin: Version: 5.4.2.18903 Support
Silverlight: Version: 5.1.30317.0 - SDK 10.6 Support
Unity Web Player: Version: UnityPlayer version 4.5.1f3 - SDK 10.6 Support
Audio Plug-ins:
BluetoothAudioPlugIn: Version: 1.0 - SDK 10.9
AirPlay: Version: 2.0 - SDK 10.9
AppleAVBAudio: Version: 203.2 - SDK 10.9
iSightAudio: Version: 7.7.3 - SDK 10.9
iTunes Plug-ins:
Quartz Composer Visualizer: Version: 1.4 - SDK 10.9
3rd Party Preference Panes:
Flash Player Support
Time Machine:
Time Machine not configured!
Top Processes by CPU:
3% WindowServer
1% fontd
1% hidd
0% SystemUIServer
0% Safari
Top Processes by Memory:
216 MB Safari
164 MB com.apple.IconServicesAgent
131 MB Finder
131 MB com.apple.WebKit.WebContent
115 MB Dock
Virtual Memory Information:
11.21 GB Free RAM
3.13 GB Active RAM
413 MB Inactive RAM
1.25 GB Wired RAM
313 MB Page-ins
0 B Page-outs