I have the same problem. It actually came on rather suddenly, and only about a week or two into the life of my late 2009 mac mini.
It's a horrible buzz when you connect external speakers (anything POWERED seems to be affected). Actually it only starts when the sound card powers up (when you start to play sound, it suddenly kicks in). If it was grounding problems it would be there all the time, I think.
I've tried everything to stop it. I'm in the UK and have never experienced anything like this before with any computer in my home. I'm not aware of any ground loop interference at all, but just incase I bought an isolator, which did nothing to help.
I'm assuming that there is just a fault with my mac mini, and I've put up with it so far as I've tended to use optical out more than analog. I have also had a number of kernel panics when inserting/removing 3.5mm jacks from the mini - which may or may not be related.
I just plugged in a USB soundcard and that is fine.
Would be very interested to hear if others are having this issue as I would like to know if Apple will fix it without too much fuss.
Regards
Firestarta
p.s Have tested in bootcamp (win7) and the buzzing is also present.