iPhone 5s voicemails won't delete

I am on an iPhone 5s with the latest iOS 7.0.4 update and I am having an issue where deleted voicemails recover even after permanent deletion. I even logged into the VM directly though a land line and deleted with the prompts and they still recover.I had ot have ATT delete my voicemail box since it is full and I use for business. Anyone out there know when ATT and Apple will quit pointing the finger and get an update that fixes the issue?????