I can't turn off the shuffle option!

You have to have a song in queue (either playing or paused) and tap the screen to bring up the scrubber bar. To the bottom-right of the bar you'll see two criss-cross arrows -- if they're blue that means Shuffle is ON. Tap them to turn Shuffle OFF (white).