Apple Continuity slowing down internet speed?

My home internet (cable 500Mbps) slow down significantly by about 50% to 90% reduction. working with AI to troubleshoot the problem, I found the the problem to be cause by Apple Continuity specifically, Handoff. When I disable handoff, my internet speed increased back to the expected speed of 500 Mbps.

The details: I enable Handoff so I could use my magic keyboard and Magic Mouse between my MacBook Pro and iPad Pro. At the time of enabling Handoff, I didn't notice any speed drop. Days went by before noticing reduction in internet speed. This is probably because during the day I'm mostly working with text files until it's time to watch Youtube and then I notice the picture is degraded. Long story short, I disabled Handoff and the I have recorded since disabling Handoff is 350 Mbps. This is OK because I have four Apple devices on my network. My speed is often in 400s Mbps.