Not to worry. Just drag & drop the folders onto the new drive. Just as a precaution, select a few files with different apps & open the files to ensure they open. Then you can drag the corresponding folders on your old drive to the Trash. Shouldn't be a problem.
Do you have another HD, either internal or external, that you use to backup all your files? You should.