Voicemail alert

The voicemail icon in the lower right corner doesn't indicate if I have any voicemails. I've missed a few important messsages because I didn't know they were there. I can still retrieve them if I call myself, but how do I know they are out there if I didn't hear the initial call?