I will be creating a new ITunes on each computer. Do I then just plug in the flash drive and copy it to the new library? Is this the same process as I created new playlists?
You may find the information in section External drive in the article below helpful.
iTunes: How to move your music to a new computer
Retrieving data ...