How to uninstall new preference panes from system preferences?

I recently got a new mouse from Logitech, and I installed the downloadable drivers to take advantage of some of the extra features. However, it doesn't work well at all, and it's added a new preference pane titled "Logitech Control Center" that completely overrides my preferences in the "Keyboard and Mouse" settings. Does anyone know how to uninstall new preference panes that are not factory-installed? I noticed that I can right-click the Logitech Control Center icon, and an option comes up for me to "Remove the preference pane," but I'm not sure if this will simply remove the icon from System Preferences without actually uninstalling anything. If anyone can give me some help I'd greatly appreciate it!