If you aren't syncing music manually, connect your iPod to your computer, open iTunes, click on the name of your iPod in iTunes, go to the Summary tab of your iTunes sync settings and check "Sync only checked songs and videos", then check only the songs in your library that you want on your iPod and sync. Unchecked songs will be deleted when you sync.