How do I close a family sharing I started?

I started a family and then added my kids. Now my husband has Apple Music and wants to add me to his. My kids were able to leave my "Family" and join his, but it won't allow me to do the same.

How do I leave the "Family Sharing" that I created to join his?