I think that's a true bug.
I have one .MP4 that didn't play upon iTunes 11 installation (only one) but in renaming it to MOV it did play.
In response to your .MPG I downloaded one such document, and it failed just the same as my other video. However, It is playable by quicktime, So I'll place that in the bug category.
-I have submitted this to Apple.