I have multiple copies of jpegs and files. How do I consolidate?

I have multiple copies of jpegs and files on my external drive as well as on my computer. I am trying to clean up both. Is there a program that will help me do this? Also, how can I prevent this from happening in the future? Feel free to be elementary and detailed. I have no experience in this department...thank you!