I can't offer a solution, but can add my experience to yours, and hope it helps Apple help us.
The Apple TV is one of 3 HDMI devices connected directly to my Sony receiver. It is the only one that crashes and freezes. (The others are a PS3 and a DTV HDR.)
It did occasionally freeze on startup, before v2, but does so more frequently now: maybe 3 times out of 5. Unplugging, waiting and restarting works almost every time. (It's a little like living with Windows.)
At this level of failure, it's wearying, rather than infuriating, for me. I could try connecting it directly to the TV monitor and see if the problem re-occurs to isolate the culprit. But in the end, I want to listen to music, and watch movies in 5.1, and I'm not going to swap out the receiver. So I'd prefer it if the Apple TV could do what my other HDMI devices can do.