Head to the “Settings” app on your iPhone and go to the “Phone” section Scroll down and tap on “Change Voicemail Password” – this should trigger a voicemail login popup alert where you can enter the proper voicemail password, enter the correct password
The blank red dot icon should now turn into a regular notification badge with a number in it, indicating how many new voicemails are available on the iPhone