Sometimes no response when closing tabs and windows

I have troubles sometimes when trying to close tabs or windows on my mac. When I try to close tabs in Safari, Finder or other windows with tapping or clicking on the little "x" with the trackpad, the software does not always respond. What I have to do to get it closed is clicking into an other tab or window and then try again. It is very annoing. I think it is a software issue. I know this happends on other macs aswell (Macbook Air mid 2012).

But what can I do to remove this bug? Anyone know of a solution?

I had the same problem before installing Mavericks and it has been a problem since I bought the machine in mid 2012. I do not use any plug-ins in Safari.