Someone somehow created an Apple ID with my email address, but I can't get into the account to delete it? Help?

I got an email today saying that somebody had created an Apple ID under my email address, and has put in their details to purchase items from the store. I'm not sure who it is, or why they've used my email address.

I've tried to get onto the account via the 'lost password' option, but when I sent an email to the address I never got one through to change it. I must sound really ditsy by asking this, but is there any other way I could get around this issue so I can delete the account created? I'm not willing to talk on the phone to an Apple employee so I'm hoping somebody on this discussion board will have a resolution to my problem.