plus sign appears when not typed

When I use the shift to type a capital letter, my keyboard/computer adds a plus sign which will 'run' across the page if I don't hit another key to stop it. It also happens when I type some number and symbols. Help! How do I stop this from happening? I have cleaned my keyboard.