Have to connect twice via Airplay to hear music?

It does this frequently, but regardless of reconnecting, updating, resetting, and reinstalling iTunes, in order to make the Apple TV function through Airplay while powered on, we're required to connect via Airplay, disconnect, and reconnect, in order to hear music.

This also can happen to iOS devices (iPhone 4, iPod Touch 3rd Gen, iPad 1st Gen)

Any thoughts on this?

After doing this, it works just fine for a while and all devices can connect.

One trend I did notice is that my Windows PC sometimes would not see the Apple TV, and that if I connected via my iPod, it would appear once again on Windows. On OS X, it says it has connected, but nothing plays until I do the disconnect/reconnect.