iOS 8.4 and new music app issues

I have an iPod Touch 5th generation. On previous versions of iOS, when I would play back music through the music app, it would play every song on every album by that artist from the point in that folder that I started playing music. Then, it would go to the first song of the first album (alphabetically) and play that song.

Now, on 8.4 it will only play the one album that I start playing music from and then it goes to the first song title (alphabetically) and plays that song. Then, it plays the next song (alphabetically). How can I get it to play all the albums by the same artist? Or is this something that they broke in 8.4?

I just want to listen to a single artist and hear all their music. Then I can choose another artist. Only being able to listen to one album at a time is very annoying.

Thanks.