How to disable raise to speak?

So this is probably a dumb question, but it has plagued me for the past year now. I just want to disable the raise to speak function on my keyboard. Some how I manage to activate it accidentally a lot when putting my phone away and it's incredibly disruptive with it's "dinging."

There has to be some simple answer but I cannot seem to find it.

merge this one, close it, do as you please, just give me an answer please!