I have an even better fix now but it comes with a health warning because I don't know if it could have unintended consequences. You might need to reinstall certain audio software to get all your drivers back but then at least you'll know which one is causing the issue.
**** I would highly recommend that you do a Time Machine backup before you try this just in case of issues******
Go to Finder, Go, Go To Folder (this is necessary because the Library folder does not show up in Finder by default)
Type in /Library/Audio/Plug-Ins/HAL/ - don't forget the first slash.
Delete everything in that folder, this will probably remove all your audio drivers, in my case many of them were old and no longer necessary and I've reinstalled what I need.
This has been a permanent fix for me so far and holding thumbs.