Text Message Contact

Above all of my text messages, I have a large J in a circle for this person who's name starts with a J. It stays there no matter how old the text is, it does not move and I cannot delete it. I tried deleting the contact but now it shows the image of a person in a circle with the phone number underneath. Any ideas on how to fix it?