Dual Monitors and mouse

I'm on BigSur 11.7.10 and have two Mac monitors with my laptop front and center. Everything works as it should with mouse pointer responding accordingly between all three monitors. However, when in clamshell mode, all of a sudden the pointer will only transfer from one monitor to the other if I scroll to very opposite direction, then it appears on the monitor next to it. I've adjusted the display settings and even physically moved monitors (ha!) to no avail.