Spotify on Apple Watch will not play downloads offline. Anyone figure out how to solve this issue?

The Spotify app on my watch appears to have my downloaded playlists available. But when I click them and they will not play. It either plays another playlist or station (if I'm connected) that is not from my download or won't play anything at all if I'm offline. Is this just a bug on the new spotify app?