Two possiblilties:
1. Go to Settings > Accounts & Passwords > Check what accounts you have added there and if one of them is sharing contacts.
2. Go to Settings > Privacy > Contacts, see which Apps have access to your contacts and turn off any ones that you're not sure about, or turn them all of to be sure.