Mouse seems to be jumpy when trying to select something

I have a new iMac M4 with the factory mouse. From the get go, once I would use for a bit, it would be tough to lock into a spot to select something. This is especially tough when trying to close or maximize a page. It may subside if you let the mouse 'rest' or change the surface you're using it on. I have tried different pads, plain paper and cleaning. They helped for a little while but wasn't a good fix. I have read through the current support articles.