I changed my email, but now I lose my reminders and contacts

I recently changed the email associated with my iCloud account, but now I frequently run into this problem where I lose my iCloud stuff (contacts, reminders, calendars) on my iPhone. I'll double check the account email address in settings, or even delete the account and sign in again. The only thing that seems to work is shutting off the phone and restarting. I don't lose anything since it's still in the cloud, but it's just annoying. Thoughts?