First some information: Photos is primarily a database that keeps track of all your pictures and the details associated with them. It’s like an Excel spreadsheet with the rows being the pictures and the columns being the details, like date, location, faces, albums they’re in, and even all the steps in editing a picture. So Photos never alters an original picture file— when you look at a picture, Photos shows you the original and, on the fly, adds all the alterations listed in the database. This is very cool!
The point of that story is that, when you update the Photos app, like you did going from Monterey to Ventura, Photos had to add new columns to accommodate all the new features. Ventura Photos could not read the old library without the right columns, and Monterey can not read the new database that has extra columns.
So you can see that there is no way to have a single library that can be read by two different versions of the MacOS.
There is only one way (that I can think of) to view exactly the same stuff on two versions, and that is to use Photos on iCloud.com. If you turn on iCloud in your Ventura Photos, then all the pictures will be copied to iCloud (possibly taking a week or more.) Another computer with the same Apple ID can connect to iCloud and download those pictures into its own Library, and iCloud with fit them into that system’s database. Of course, iCloud will cost a bit.
You can, of course, restore the old version for your iMac, but it will be static-- new pictures added in Ventura will not appear there. Using iCloud means you can add, edit, delete, or whatever, pictures on either machine and the same will happen in the other.
You say you have backed up your Library with Time Machine. Is TM on the same hard drive? If so, you may have trouble — unless they exist on separate volumes. Time Machine can mess up a a Photos Library that’re on the same volume, even if TM is deleted. And to avoid damaging the Photos Library an external drive must be formatted in either APFS format or Mac OS Extended (Journaled) format. The volume can not have had Time Machine on it since it was formatted.
Move your Photos library to save space on your Mac - Apple Support