Mouse touch scrolling halts

This happens at irregular times. Regardless what application I am in, I can be scrolling in a window by touching my Magic Mouse with my finger and swiping up or down when scrolling halts. I can not get it started again unless I close the window and open the location again. I have tried everything to no avail.