Driver's (kext's) are installed in /System/Library/Extensions. To remove one drag it to the trash and reboot.
Make sure you know exactly which kext you are deleting. I assume this is a driver you installed because you don't want to remove any of the apple installed kext's.
Note, after adding or deleting kexts, the following reboot will take longer since the kext cache needs to be rebuilt.