Contact with multiple emails - Only need one as VIP

In iOS 7, setting up some VIPs in email so I'll get an alert when an email comes from them to any of my multiple email accounts. Really do like this feature.

I have one contact who has multiple email addresses, but I only want the VIP alert for one of them. Is there any way to do this? From what I've found, you can't just have one of those emails in the VIP list. When you add the contact, it adds all of that contact's email address to the VIP list.