Voice Control coming on in my pocket all the time

Greetings-- I have a new iPhone, and voice control has been activating and then calling people while the phone is in my pocket a couple of times a day. I just discovered this is because Voice Control activates when you hold down the Home button, which seems to happen if I'm sitting in certain positions (my phone case makes the button more convex than concave), and then VC is trying to parse random conversation around me as names and sometimes succeeding.

Another thread seemed to imply if I turned on the passcode feature, that would solve the problem, but VC seems to come up if I hold down the Home button no matter whether I have a passcode turned on or not.

Any ideas as to what I can do to eliminate this? I don't anticipate ever using Voice Control-- is there a way to turn it off or map its activation to a different button I'm less likely to trigger accidentally?