remove application not possible

I try to remove an unwanted applicationfrom my iphone downloaded from app store.

Long press on the icon, wait for jiggling icons, press on the cross.

But:

1. nothing happens still jiggling icons

2. iphone is completely unresponsive

3. also on hard keys and long press hard keys

4. after a view minutes iphone creates a soft reset (black screen white apple icon) and comes back

5. and the app is still available

What I am doing wrong here?