Library album cover arts don't load

For some reason in Apple Music for Windows library album covers don't load at all.

However if I search for albums, I can find them and they will have cover arts.

I've had this bug ever since the release of Apple Music Preview for Windows 11. I tried re-installing, cleaning app data, cleaning Microsoft Store data - nothing helped.

Edit: I just checked my Music\Apple Music Library.musiclibrary\artwork folder to see if it actually downloads album arts and it in fact does, but it fails to display them when Library window is open.