Facetime failed

Does anyone has this issue? When I try to start facetine with someone, it always says "facetime failed", but when I hit "call back", it will work.This happens on ios 4.1. Now I've restored my phone to 4.2, I still have this issue, but instead it says"facetime ended", also, when I hit call back, it works again.