Since you want to restore what's on TM to the SSD, the SSD needs to be booted from to receive the restored files and to do that, the SSD has to have an OS on it. And since you'd want to have the SSD's OS updated to the latest ML version eventually, you might as well do that first, since, to some degree, it's also a test of the SSD's functioning. Since you already have the Combo updater, you could just run that, and since it's only a bit over 800 MB, it might even fit on the flash drive. I don't believe that migrating from a TM file made by and containing 10.8.3 data would be problematic when initiated from a 10.8.0 installation (which is I think what you're asking), but there may be some subtle software changes we don't know about that could come back and bite. So starting the migration after updating to 10.8.3 would be the safest bet. At the same time, Setup Assistant brings your existing account stuff over to just reestablish your existence on the SSD, while Migration Assistant is run after a new account has been set up on first boot, so I'd think Setup Assistant is the better way to go.
In which case, how about this: when you run the Combo updater, you are given a choice of which drive you want to install it on. If I remember the sequence correctly (it's been a while since a fresh install), you run the installer, which transfers files to the target disk, and then reboot. The installation takes place on the target disk which then reboots again to begin the setup process. When the startup chime sounds the second time, use the option key to run Startup Manager and pick your flash drive to boot from again. If you already have the Combo updater on the flash drive, run it from there and pick the SSD as the target. When it's finished, if it doesn't start from the SSD, choose that as the Startup Disk (check to see that it says 10.8.3 in Preferences) and when it boots, start the Setup Assistant process using TM.
Or is the flash drive only an installer, meaning it doesn't actually have ML installed on it so you can't use it like an actual boot disk from which you can do normal boot disk things?