Can you change Apple Watch Ultra 2 bands daily?

I have a new metal band that i really like, but it really hurts my wrist during sleep so i change it every evening with a silicone one and back to the metal on the morning. I'm curious if that could cause the watch mechanism (the key essentially) to get damaged some time in the future or is it just "bulletproof"?