iTunes basic functionality is: The .itl file contains a list of all the tracks you have. As you add them it notes their location and stores this. After that it does not check on the file unless you try playing it. The default behavior is for iTunes to put a copy of any file added into its media folder in a hierarchical structure. So it is possible under various scenarios (usually user-caused) for a file to be moved and iTunes' reference for it to be wrong. If everything is stored in a "portable" single iTunes folder then references are internal, but once you start splitting the library into media in one place and library files in another all the pathways to the files have to be preserved or the main library file loses track of files.
Now there may be an explanation for this but so far we have been working with several assumptions on how you stored and elected - or not - to let iTunes manage your media. I, for example, have this disabled which gives me more flexibility in managing my files and folders but in turn means I need to be on top of that management because iTunes is not doing it for me, and certainly nobody sitting half a world away is going to have any idea how it should look on my computer. So maybe there is a reason for simple solutions not working for you but we haven't really learned that much about how you set things. Normally restoring from a Time Machine backup should be as simple as dragging the old iTunes folder (the entire thing as a single item, not just the media folder, and not scattering bits and pieces over the desktop) onto the main drive into the Music folder and starting iTunes again.
If you have been managing media yourself it can introduce all kinds of complexities and then we need to re-approach the situation with that in mind.
Yes, you can rebuild a library from scratch from the media files alone. Just start iTunes. It should create a new iTunes folder in Music. Drag all the media files to the Automatically Add To iTunes folder. About the ‘Automatically Add to iTunes‘ folder. [Archived] - http://support.apple.com/HT201970 - Files put into this folder are actually moved from this folder to the correct location in the iTunes Media folder.