how to delete apps permanently

At the moment you can't permanently delete any items from your purchased list, all you can do is hide them so that they are less visible (they won't appear in the Purchased tab) : hiding and unhiding. As your tagline says that your phone is on iOS 6 then you will need to do the hiding via your computer's iTunes, it doesn't work directly on iOS 6 devices