Time Machine won't let me click on any dates and restore

I have a 2 TB WD hard drive that I have connected via USB 3.0 on my 2013 iMac running Mavericks. When I went into Time Machine to select a date to restore a file it wouldn't take me to the date to find the file. I know when my oldest backup was so I know I am not going past that. I can't even restore from yesterday. Its like Time Machine is frozen. Has anybody had this problem or know how to fix it? Thanks