Can connect to some, not others

For a number of people that I try to reach on FaceTime, the buttons to start an audio or video call stay grayed out. I have entered a person's phone number and email address. Some are definitely in my contacts, but don't show up when I search within FaceTime. Others work fine.