Wow, AbuYang, that's major packet loss for HDMI (Mac mini M2) to DVI (monitor). 51%?!?!? So not only are ping times extremely longer, but more than half of the ping packets are lost? That would create a Wi-Fi data slow down I'd think.
I noticed when you touch the HDMI cable jacket your thumb contacts the top of the Mac mini, am I correct? I think you might be grounding the HDMI cable to the metal case of the Mac mini. I'm wondering if attaching a metal electrical conductive wire, aluminum foil, etc, from the HDMI cable plug's jacket to the case of your Mac mini might reduce interference as well as your finger. Then you wouldn't need to touch/hold the HDMI cable's jacket. Do you have something electrically conductive that you could wrap around the HDMI cable' plug jacket then attach to the metal case of the Mac mini? Maybe type the other end to the metal case of the Mac mini.
btw, you should be getting 0.0% packet loss. packet loss will reduce speed more than a high ping time.
Can you try that to see if grounding the HDMI cable's jacket to the metal case of your Mac mini with something electrically conductive works as well as your finger? Maybe wrap metal around the HDMI cable's jacket then tape the other end to the metal top case of the Mac mini.