How to remove a number which i no longer access to from my apple id.

Hi,

So i have lost a number which i added to my apple id and i have noticed some else is now using the number. now i am unable to remove this number from my apple id and was worried if that person can see my data. kindly help me to remove his number from my account. thank you