"install_flash_player_osx.dmg is in use"
Generally, the OS is telling you that the .dmg (any .dmg, which means Disk iMaGe) is still mounted on the desktop. When you double click a .dmg file, it puts a pseudo drive icon on the desktop. It's not physical drive like an external hard drive or other device, but the OS pretends it is. Usually, a mounted .dmg will have an icon of a plain white external drive on the desktop, like this:
If you're not seeing any drive icons on your desktop, that would be because they're off by default. From the desktop, choose Finder > Preferences from the menu bar. Under the General tab, turn on the check boxes for at least the first three types of drives. They should all now appear on your desktop.
The name of the "drive" will usually be similar to the name of the .dmg. So until you dismount the pseudo drive, the .dmg is "in use". Like any other drive in the Mac OS, you drag it to the Trash, which will change to an Eject icon. Once the drive has been put away, then you can delete the .dmg file. Highlighting the drive and pressing Command+E will also dismount the drive. The very long way around would be to restart the Mac since a pseudo drive can't remain mounted between startups.
From there, you can decide whether or not to reinstall the Adobe Reader, or use Preview. If you leave the .plist and other small files on the drive softwater mentioned, it makes no difference. They're useless without the parent app which would access them. So the only thing they'd be doing is taking up a very small amount of disk space.