my caps key switches the input language

So, Hi. I have a issue where when I hit my caps key it doesn't light up and then it switches my input language to Russian since I use the russian keyboard input to joke around on discord with my friends. I really want help because this is really annoying so pls help. ;-;