Apple Music on Windows 11 won't play songs, just skips through them

After installing Apple Music on my Windows 11 laptop, I can access all my music and playlists but when I try to play any track or album, Apple Music just skips all the tracks and starts playing related music.

I suspect it has to do with a previous iTunes (now uninstalled) installation or a previous iTunes library in my Music folder (now deleted). Reinstallation hasn't fixed.

I see others have had this issue in iTunes for Windows 10 won't play any song… - Apple Community but no-one posted a fix for it. Anyone found a fix?