Morning bmrug,
Thanks for using Apple Support Communities.
make sure your router isnt blocking ports.
For more information on this, take a look at this article:
Apple TV: TCP and UDP ports and protocols used
http://support.apple.com/kb/ht2463
TCP port 123 is used to communicate with a network time server.
Best of luck,
Mario