macbook keeps randomly switching from desktop to dashboard when im not touching the trackpad

My 13 inch mac book pro (running maveriks 10.9.4) keeps randomly switching from the desktop to the dashboard when my hands are no where near the track pad. Its happened several times but this time I had Skype open and was messaging a friend. I was writing in a notebook on the other side of my desk while I was waiting for them to respond to my last message. The mouse started wandering a little then the screen started flickering back and forth between my desktop and the dashboard on its own. It did this sporadically for a couple minutes before going back to normal. While it was switching I tried to click on things or even type on the desk top but it would just switch back to the dashboard when it felt like it. Does anyone have any idea how to fix this?