I'm kinda obsessive/compulsive about some things, so I usually keep the .dmg files on my desktop until I've used the applications a few times, just to make sure I don't have to reinstall, re-download, etc.
But in all the years I've done this, I've gotta say I've never once had a use for the .dmg files again, so it's probably best just to trash 'em right after you've installed the application on your machine.