removing drivers

I've downloaded a decent amount of programs to my new Macbook Air, and I've found that the drivers from these programs are now in my Desktop. Upon trying to drag them to the Trash, I received an error message stating I could not complete this action, as the drivers were in action. Being a perfectionist, I prefer my desktop clean and organized... Is there any way to remove these drivers from my desktop?