I only want phone contacts on my phone!

I recently upgraded from an iPhone 4 to an iPhone 6 and to my dismay discovered that my contacts list had been bulked up by every email contact I have ever had, making it a nightmare to pull out the phone contacts I really want to find. How do I go back to where I was? I only want phone contacts on my phone!