Weird to watch it vanish in real time. I think iCloud has an undocumented limit on the number of email addresses that can be reliably associated with a Contact.
Update: I think this is a bug related to El Capitan’s inclusion of email taken from mail.app correspondence and a timing bug related to dsyfunctional Contacts.app sync. I turned off the former.