Can I use a car charger for my 4th generation iPod?

We're going on a vacation tomorrow, and since there's no promise I'll be in reach of a computer until I get back, I was wondering if I could charge my iPod with one of our car chargers. On the other hand, I'm slightly reluctant to do so, I've heard before that it can actually fry the iPod?