Can't clear notifications iOS 9

Certain notifications have been stuck in notifications center for me (iPhone 6, iOS 9).

When I click the "x" the "clear" option appears, but when clicked it just goes back to the "x" and the notification remains.

Restarting the phone seems to fix the issue but then it occurs again.

It seems to happen primarily to notifications from Mail.