@fishcow Your symptoms are almost exactly the same as mine were. I am guessing, but may be wrong, that your youtube settings are for the default flash video option which worked fine for me too. However I prefer the HTML 5 option that you can set for your Youtube account and that was problematic sound wise.
I am reluctant to blame the interface drivers of any of these devices as :
a) After disabling AppNap ( or worryingly performing some completely unconnected action ) for Quicktime and Safari everything worked fine.
b) The sound in so many other ways ( Itunes music , Logic Pro, Quicklook etc ) worked fine.
I think it is Mavericks/Quicktime that needs to be fixed not the audio device driver.