Duplicate Contacts Created When Editing

When I edit a contact on the iPhone, iPad, iCloud, or on my PC Outlook 2007, the contact duplicates with one containing old info and one containing updated info. The duplicates appear everywhere but Outlook. If you delete the old, it deletes both. I've seen many solutions about merging duplicates but am looking for a solution to the problem, not a work around. Any ideas?