iPhone voicemail

I cannot find where to delete the messages I have deleted in voicemail. My mailbox is full even though it has 4 current messages. It does not “pop up” when I enter the voicemail area. I can delete my voicemail but cannot delete the ones that have already been deleted. How can I get access to those deleted messages?