Why is my battery losing charge when I don't use my shuffle for a while?

And One of the last times I used it on a backpacking trip I ran it down to no charge left then it would not charge useing the portable charger I bought. It's really frustrating since I mainly use it for extended backpacking trips and need to be able to charge it with a portable charger.