Send sms to phone instead of imessage to email

I am on an iPhone and have a contact with an email and phone number. The contact uses the email with iMessage and can access this through his iPad. They use an android for text messages. I would like to text this person and not use iMessage so that it will go to his phone which would require sending an sms message. Since my contact card has his email address setup to go to iMessage and his iPad, my phone sends an iMessage to his email instead of a text to his phone everytime.

How can I force my message to go as a text to his phone for this contact?

If I manually type in his phone number I can send a single text message to it, but any subsequent messages go as iMessage unless I manually again type his phone number for a new message.

Do I have to create 2 contacts for this person one with his phone number and one with email? That is not something that makes sense and I am hoping there is another way, but can't find anything.

Thanks