Cannot remove keyboard from lock screen

This is a weird one. I used to have a Russian keyboard installed on my iPhone along with English. I wasn't using it so I deleted it. It's gone from every app, never shows up in the keyboard selections. But, for some reason it's still showing on the lock screen as an available keyboard. I can't for the life of me find where this would still be set or why. How do I get rid of it?