Late iMac 2013 with mavericks Magic Mouse

After every single start up after about 10mns of use my magic mouse loses the ability to pull things.. I can still click, double click, right click, scroll without any difficulties but I just cant move anything! Ex: whenever im in logic i cant move any regions anywhere on the grid or I cant move a folder around on the desktop. This is rreally frustrating and forces me to restart my computer everytime to get it going again.. anyone knows what's causing this to happen?
Thanks.