Hello gregbiehle,
Photos can very much be one of the largest consumers of space on your device and in your backups. A large collection of photos can take quite some time to redownload after a restore (as the device will complete the 'restore' and power back up so that it may be used prior to all of the photos being redownloaded). I would recommend connecting your iPhone to a charger and connecting to a strong Wi-Fi network, as this can speed the download process up substantially.
After your settings and accounts are restored, your device restarts and begins downloading your purchased music, movies, TV shows, apps, books, Camera Roll, and other content. You can use your device normally during this time, but if you receive an alert or are having trouble completing the restore, connect your device to a power source and make sure that it is connected to the Internet via Wi-Fi. Then allow the restore to proceed without interruption.
iCloud: Troubleshooting restoring an iCloud backup
http://support.apple.com/kb/TS4036
In the future, you may consider importing your photos from your iPhone to your computer in order to keep your camera roll slightly smaller, as this can greatly reduce backup and restore times.
If you delete photos after you import them, you can reduce the size of your Camera Roll and improve backup and restore times.
iOS: Import personal photos and videos from iOS devices to your computer
http://support.apple.com/kb/HT4083
Cheers,
Allen