E-mails on iPhone 5 Won't Delete

So when I open my mail and I read it over and everything, I delete them. Then when I come back later to check my mail the same e-mails are there and I keep trying to delete them but fo some reason they won't disappear. Now my inbox is piling up with old messages and it's kinda annoying.