My iMessages are sending to other people in groups with my number and my Apple ID

We got the new iPhone 16s and purchased the Apple one and shared with our family. Whenever I send messages to anyone in my “family” it will switch back and forth sending the message from Apple ID email address and my number. The weirdest part is that ive removed my email from my iMessage in setting and it’s sending a group message to my family from my phone number to their phone number AND my email address.