Mouse very laggy on universal connection

Running two Mac minis one a intel and the second an m1 . whenever I moved mouse over to the other mini via universal control the mouse on that screen is very very laggy . At first thought it was my router , bought new better one and problem is still there .

Makes using it this way impossible .

I also thought it was also because I have the two connected via firewire bridge but disconnectioning it gives same results