Check out this Apple KB document:
Macintosh Restore DVD: How to install iMovie, iPhoto, or iTunes using Mac OS X Software Install
You should have a customize option somewhere in the process that you can use to select just what you want to install. You will, however, have to delete all files with "iPhoto" in the file name that reside in the HD/Library/Receipts folder beforehand.
I assume that the iLife suite came installed on your new PB or with Panther, do you know?
Anyway, Follow the next link and then follow the link on that page that pertains to your PB. Good luck and get back if you get it installed.
How to restore your Apple software
Oh, before you install it,
To reinstall iPhoto...
Navigate to /Applications and drag iPhoto to the trash ( you already did that
Navigate to /Library/Receipts and drag all iPhoto receipts to the trash
Navigate to ~/Library/Preferences and drag com.apple.iPhoto.plist to the trash.
Insert your iLife CD/DVD and choose to do a custom install. (In your case follow instructions from one of the links)
Run Software Update and update iPhoto.
No big deal - as this is normal to do when You have messed up the library as I have done as well.
The way I did it - I just dropped by Apple one day - and in less than two seconds - it was done.
I tried as You are to solve it in here - and I went around for 2 week going insane.
I wish I could recall the moves that were performed - but I'm serious - it took less than 2 seconds to reset it.
So give them a call or just go into one of the Apple Stores.
I'd even pick You up to go there - But I'm in Amsterdam the passed 2 months.