And you did a Reset following the directions I linked above?
If so and it did not help, you can try doing a Restore on the shuffle in iTunes. Select the shuffle in iTunes. The Restore command is on the shuffle's Summary or Settings tab (depending on model). This will erase the shuffle, re-install its software, and set it to default settings. If a software glitch is causing the problem, a Restore should fix it.
If a Restore does not help, the button assembly may be faulty. If the shuffle is a 4th gen that is less than one year from purchase, it is under warranty. If you bought AppleCare with it, the coverage extends to a total of two years.