Iphone 4 will not allow me to re-listen to my voicemail messages.

My Iphone 4 will allow me to listen to a voice mail message once, but I can't do it again. I have newest software updates and have tried rebooting, restoring? Any suggestions or am I missing something here?

Thanks....