Facetime audio/video will only work with Apple ID's, not phone numbers

I recently got a new sim card (in the US), and I am unable to call anyone through facetime video or audio unless it is their Apple ID. I can accept incoming facetime calls, but cannot make outgoing ones unless it is an e-mail address. It won't let me call if it is a phone number. I have adjusted my settings under facetime, but it hasn't worked.