Still can’t remove a deregistered phone number?

If the phone number is still in use a confirmation will be sent to it that needs to be acknowledged (this prevents someone else from deregistering your number).

If the phone number is no longer in use there is no need to deregister it; it will automatically be deregistered when it fails to “report in” to the iMessage and FaceTime server in a day or two.