I had a similar problem with videos I converted from .wmv to .mov via QT; They would play in iTunes, but not sync to Apple TV. Here is the easy, cheap, fast way to fix it. Also, Flip for Mac is an excellent alternative when it comes to wmv conversion. You must pay for that though. The following reply is copied and pasted from an Apple Corp. support page directly, (
http://support.apple.com/kb/HT1532 ). It should solve your problem.
If you can play a movie in iTunes but you can't sync it or stream it to Apple TV, select the movie and then choose Advanced > Convert selection for Apple TV. This will create a new copy of the video in your iTunes library that is compatible with Apple TV.
Note that files created using the "Convert Selection for Apple TV" option in iTunes may not be compatible with iPod or iPhone. If you want to make a file that will be compatible with video-capable iPods and iPhone as well as Apple TV, choose the "Convert Selection for iPod/iPhone" export option instead.
You can also use QuickTime Pro to convert your content that opens in QuickTime Player, into a format playable on Apple TV. QuickTime 7 Pro includes a new export option that supports H.264 video encoding up to 1280x720, 24 fps Progressive depending on your source material.
In QuickTime Pro, choose File > Export > Movie to Apple TV to create an Apple TV compatible file.
Note that files created using the "Movie to Apple TV" option in QuickTime Pro may not be compatible with iPod or iPhone. If you want to make a file that will be compatible with video-capable iPods and iPhone, as well as Apple TV, choose the "Movie to iPod" export option instead.
About video formats
If you can't add or play a movie in iTunes or QuickTime Player, then you won't be able to convert it to play on Apple TV. Some examples of movies you can't add or play include WMV, AVI, DivX, RealMedia (rm), and Flash format files. Some third-party utilities may be able to convert these types of movies to a format compatible with iTunes and Apple TV.
H.264 is the base format, but see this page for more detailed specifications of the compatible video formats.