How do i change/remove my trusted phone number

My trusted number was my direct line at work. we changed phone systems and that direct line no longer exists. How do I remove the trusted phone number in my apple id?

I know I can add another then the other will have an x next to it to remove, but I have no other number to replace it at this time, and extensions do not work for verification phone calls.