If it's in GBs it's unusually large. This often happens when the iPod data base becomes corrupt.
If the iPod is enabled for disk use, you can look at the folders on the iPod through Explorer or Finder and delete anything you don't want.
if it's a corruption it may need to be restored, see
how to restore the iPod to factory settings which will erase the iPods contents and reclaim the used space.
Then reload the music from iTunes.