How do u listen to music from the ear buds on my iPhone without the music coming from the bottom speaker??

I have an i4 and I can't figure out how to listen to my music from the ear buds without the music coming out the bottom speaker. Any ideas on how to change this? We have tried to silence the phone, change the options for the music app & we can't figure it out. Someone please help!