Just an update on troubleshooting steps that have not resolved the issue. Organizer account is not affected, but all family members are. Each computer is running iTunes on a mac, and signed into iCloud with the organizer's apple id, but iTunes with the individual apple id's. This is so we can share desktops and documents through iCloud across multiple machines, as well as be able to use Back to My Mac screen sharing. I thought this might be the issue, so I signed into iCloud using the family apple id's, as well as iTunes using the same id. Issue persists.
Also tried other things like signing out of iTunes, turning off "Show apple music features" in preferences, and signing back in. Issue persists. Definitely feels like something happening on the account side of things, and nothing that I can control or set up incorrectly. Next steps might be individual apple music accounts, but in the meantime, we're enjoying spotify family.