Do those two voicemails really exist (and you can't delete them), or it's only a matter of a wrong "badge" notification?
Should be the latter, try to sign out from your Apple ID, restart your iPhone, then sign back in to your Apple ID.
If the issue still persists, since voicemail is a specific carrier's service, contact your carrier and ask them.
Regards
Giulio