How to fix unavailable local files still showing in Music library

I recently changed from Spotify to Music, and made sure to remove all playlists I had from local files. I also deleted all downloaded tracks from my Mac, so I could only see music from the streaming service, but the former local tracks keep on showing in my library as unavailable, but still there.

Not sure if any of the settings below should be changed, but there are no downloaded tracks in storage.

[Re-Titled by Moderator]