Adding photos to existing album

I have already started a book and have 50 pages done, but I realized I wanted to add extra photos. I was able to add them to my smart album, but they won't pop up in the column for adding the photos for my book. Do I have to start over?

Thanks.