Playing music randomly fast forwards and I can't do anything about it. Pause button does nothing.

I've run into a strange issue on my iPhone 5 where some times when I play music it will keep fast forwarding and will not stop regaardless of what I do. I try pressing the pause button and it does absolutely nothing but acknowledge it's been clicked. I tried quitting the app by double clicking the home button but once I go back in it is still fast forwarding. What gives?