Annoying ics events controlling iCal

Is there any way to stop the annoying ics events that people attach to e mails from taking over iCal and automatically setting up events? I went into my mail app and under preferences selected 'Never' for "Add Invitations to Calendar' but still they come. Then once they are on your calendar you can't get rid of them. Any one have a solve?