AirPods case stained

After putting my AirPods case on a black microfibre towel to avoid scratches, I’ve realised that I now have small black stains on the backside of the case. I’ve read some other posts on this issue and someone said that using a magic eraser is a good solution. But would this cause more scratches or get rid of the glossy finish if I used this? Thanks