Alarm going off even when I turn it off

Twice in the last week I have set a morning alarm on my iPhone5 and then several hours before, morning plan changes and I flip the button from green to white to turn it off. Twice it has gone off anyway. Anyone else having this issue?