MacOS mouse issues with Windows RDP and VMWare Fusion

Recently I have been having mouse issues when RDP'ing to my Windows 10 machine. I am also experiencing the same issues while using VMWare Fusion to my bootcamp Windows 10 instance.

The mouse in either of these scenarios the mouse keeps re-centering to middle of the screen. These seemed to start happening after upgrading to 10.13.3 and still happening on 10.13.6. These are two mutually exclusive scenarios where the mouse is not working from inside Windows.

I'm not 100% sure where to start. I'm not sure if a Windows 10 driver on these separate machines is causing this or what the issue is. I have tried removing the mouse drivers from device manager and then let it pick up a new one and that didn't solve the issue.

Anyone else deal with this? Any ideas why this would happen in both of these scenarios?