I have been plagued by the same issue for quite a while now. I "think" I have got it solved - well, I'm 99% sure I have) and it seems to be down to my router.
I have FaceTime on my Mac, my iPad 2 and my iPhone 4s.
My wife has it on her iPhone 4 and her iPad 2
We have been trying to use it ever since iOS 5 came out. It freezes intermittently and I always thought it was down to bandwidth.
Have tried different routers, different connections and pretty much every connotation available to me.
I kind of assumed FT was just "buggy" and not fit for purpose, but others were telling it worked fine.
I'm on a 100mb connection, so I know it's not bandwidth. I have tried different MTU settings, etc, but still lock ups.
Had one conversation with my brother recently, to my overseas "home", and it worked perfectly.
So now I know it works, I have tried other calls - to my house. Everything dies at various intervals. Sometimes it last 3-4 mins, others it lasts 10 before locking up - the other end can see me, or vice versa and hear but the other end hears nothing or a frozen screen.
Talking to my son just now, we had the same problem, but I happened to be looking at the firewall log at the time.
The call started to lock up - it was almost a mobile phone commercial "can you hear me now?"
Unchecked the DoS setting for udp_flood on the router and the call resumed perfectly.
Carried on the call for half an hour and no problems.
Since that setting has been unchecked I have had no issues with FaceTime.
The setting was at 150 packets per second and then blocked it for 10 secs.
Leaving it off cures it, but I am sure that fine-tuning would allow it back on to prevent DoS but still allow FaceTime to work.
I don't normally post to forums, but since this had frustrated me for over a year now, I hope it may solve it for others suffering the same issue.