The date/time is only one possible cause. In my case, the date command was producing the correct time, date and time zone. While I was finally able to get Mavericks installed last month, I ran into exactly the same download problems with Yosemite.
On my other computer, I used the OS X installer download to create a bootable USB installer drive. This installer also failed to work on the problem machine. It did however load the 10.10 Utility partition, so I was able to repartition the drive, reformat it and download a copy of Yosemite from this clean environment. Again, the installer failed to download multiple times, regardless of ethernet vs wi-fi, no screensaver or sleep active or user input. I even tried installing to an external drive to rule out the hard drive in the machine. Still no success.
The installer Log gave an error about unable to verify InstallESD.dmg and there was an error about verification failure from hdiutil.
This morning, I pulled the 8gb Crucial branded RAM upgrade replaced with the old RAM shipped by Apple. Presto. Installer works fine, and I'm posting from the machine. I suspect the installer that would not verify on the USB drive will also now work to install.
In the end, my failure was based upon faulty RAM.
Note: I could not access the Apple diagnostic to test the RAM.