Magic Mouse 3 not moving pointer but responds to scrolling and clicking

I had a Magic Mouse 3.0.6 and Apple keyboard with a 2011 iMac. I have successfully connected it to my Macbook M1Pro but when I'm moving the mouse nothing happens. However, if I click, right-click or scroll, it works fine.

I have fully charged the Duracell AA batteries I am using in it, and I have tried to disconnect it and reconnect it a few times already. I also restarted the computer. I tried to use it on different surfaces as well.

Is it broken or is there a way to fix it? I haven't been able to test it on another computer, the iMac is at my mother's.

Thanks in advance for your feedback.