Hmm, I checked again today - and now it is indeed working. Hopefully it will stay that way ..
@fewpix: On a different, but related topic that you brought up. Before I joined Apple Music my Smart playlists behaved much better because they were not Live. With Apple Music I am unable to disable Live updates to my smart playlists. Unchecking ("Live Updates") in iTunes does not work. Smart playlists are always live.
The problem I have with Live updates is just like you described. I also have smart playlists for my unrated music. If I rate a song, it immediately stops playing and disappears from the playlist. If I press the wrong star button, there is no way to go back and correct it unless I remember the exact name of the song to search for it manually.
I have the same problem for my other smart playlists that usually include "not played within the last <n> weeks". If I decide I want to re-rate a song that just played, or want to see what just played if I cannot recall the artist, once the song has played it has disappeared from the playlist, and one cannot go back in history. If you happen to know if it's possible to go back to the most recent song in this scenario, please share...
Completely off topic, the other problem I have with smart playlists in Apple Music is that they cannot be based on other playlists. These playlists can be created in iTunes on the computer, but are never available on my phone (crossed out cloud in iTunes even if all the songs are in the cloud). Example: I have a Favorites playlist (not smart). Then I want to create Smart Favorites -> song is in my Favorites, has 4 or better rating, and not played within the last <n> weeks. I was able to get around this by adding a specific keyword in the Comments field and use this as a criteria, but that won't work if I have other comments I want to keep, and it's hard to maintain as I change my Favorites playlist.