Make sure the contact has a 10-digit number, not just the 7-digit number.
If that isn't it, does the problem only happen with iMessages, SMS or MMS messages?
Try tapping Settings > Messages, then turn SMS and MMS off. Test, then repeat again only leaving SMS or MMS on.
This Apple doc has some good tips too -> iOS: Troubleshooting Messages