Magic mouse wont release files/folders when trying to move them

This is an on and off problem where when trying to move files/folders to trash or to another location the mouse wont place the file where i release the click.

Instead it stays with the mouse unless I take it back to where it was selected and click furiously and press escape.

Not major problem but quite irritating, also is a persistant problem that occurred on both mice i have owned.