Can I just move my movie files and leave my music files where they are?

Yes, but bear in mind if you move the movie files, any files, from the iTunes media folder iTunes will not know where they are and therefore cannot access them. It will be up to you to tell iTunes were they are in order to use the files.