! in photo boxes

About half of the photos in my iPhoto library show up in small form but when I double click on them a large gray box with a ! in it appears. I'm trying to store my photos on my external hard drive, I think it has something to do with that....