Finder audio not using correct output

When I connect my headphones, sometimes the audio glitches and the sound when I move items, empty the trash, just anything related to finder, is played through the macbook speakers and not my headphones.

This is usually solved by a restart, but it's rather annoying when I have to restart almost daily at random times.

I would reset the nvram and smc, but it doesn't seem like it's needed because it fixes itself when restarting.

Will do so anyways and update thread