Delete from Library - An unknown error has occurred

Using Apple Music for Windows.

When selecting a song in a playlist and pressing delete I'm getting an error pop up at the bottom of the screen:

"Delete from Library - An unknown error has occurred."

They stack if I try again.

There doesn't seem to be a remove from playlist in the right-click context menu (unlike on the iPhone Music app) so the delete key is the only way I can think of to try and remove them.

When I use the 'Remove from playlist' option via iPhone Music app it successfully removes the song so I can only assume this is a bug in the Windows Apple Music app.

Any advice on how I can actually remove something from my playlist via the Windows app?