Magic Mouse gestures not working properly when I have more than one device connected via bluetooth

So, I've been investigating for a few weeks now and it seems like there's something wrong with Bluetooth on MacOS.

Whenever I use multiple devices, the Magic Mouse gestures stop working properly after a while.

It becomes slow and unresponsive, which is super weird. The only temporary solution is to turn the mouse off and on again, but the problem comes back after a few minutes.

Strangely enough, the only scenario where everything works perfectly is when the Magic Mouse is the only device connected via Bluetooth.

Do you guys have any tips on how to fix this so I can use my Magic Mouse with multiple devices connected via Bluetooth?

Thanks in advance!