Won't work if a song is already playing and you choose another artist. When you press the play button the original song, not from the artist's list, will start playing again. You literally have to close the music app and reopen it to achieve the once simple task of playing all songs by an artist. In order to achieve the "one button" ability of playing all the songs from one artist like in iOS 4, you have to perform a holy miracle now. The "Music" app is riddled with so many bugs and problems that it is n't even funny. Apparently the iPhone Music app is completely different from the iPad Music app.
So many things that were fixed in iOS 4 are now back to non-functional in iOS5 Music.
It will take 2-3 updates from Apple to fix this application.