So I was having this same issue described in this thread and I believe I resolved the issue by making a change to my wireless network.
My wireless access controller (enterprise cisco network however same applies even for home routers) was advertising one SSID for both 2.4 & 5.1 GHz wireless networks. There is a feature in most new wireless access points called band steering. If you only create one SSID for your wireless network and it rides both your 2.4GHz and 5GHz network than your device will switch bands based on many factors including interference / congestion / signal strength. This explains the randomness of the connectivity as a microwave, or passing car, cell phone, or neighbor can generate wireless interference very easily. The issue resides with the sending device however because the issue was still happening on Apple TV's that were not configured for wireless and actually plugged in via ethernet.
So my solution was to create a separate 2.4GHz and 5GHz wireless network SSID (wireless2.4 & wireless5.1 for example) and then configure my laptops on the network to only connect to the 5GHz network, and not allow them to switch based on the algorithm it uses to determine what the best connection is. I went ahead and joined my apple TV to the same wireless5.1 network so that it would not "flap" between the two networks and simply remain connected to the one band. This same solution works if you configure your users to connect only to the 2.4GHz network you just need to be sure that "N" is disabled for the 2.4GHz range because "N" will operate in both bands.... Tricky, I know.
I implemented this solution in a couple of conference rooms in a 150,000 square foot manufacturing facility where we are all Mac based, and so far everything is working well, after the changes mentioned above.
Hope the info helps.