After pausing or being turned off, the shuffle doesn't pick up when it stopped.

I have a new shuffle and want to use it to listen to audiobooks. When paused or turned off, it does not hold my place but slips backwards. With no display or counter I spend more time looking for my place than listening to my books. Is there a fix for this? Does anyone else encounter this?