iPhone Alarm won’t sound through speakers when AirPods are out of case

I fall asleep with AirPods in but often they fall out and are still connected because they are under my back or one is still hardly in my ear. This is a problem when my alarm goes off because the sound will not go through the phone speakers. I’ve missed several alarms because of this which makes it stressful and worrisome to wear them to bed. Is there a way to make sure the iPhone alarm ONLY plays through the phone speakers and NOT the AirPods?