"The identity of the backup disk “Airport Time Capsule” has changed since the previous backup" and my computer wants to do a full backup which is not necessary.
If you "restored" your Mac, you have in effect a "new" Mac identification wise, so Time Machine does not recognize your "new" computer.
The backups that you have now on the Time Capsule were from your "old" Mac and Time Machine will not back up to that file. You'll have to go with what Time Machine wants to do......start a new backup of your "new" Mac and work forward from that point.
A secondary question I have is that there is an old backup on my time capsule from my previous computer, which I definitely do not need anymore. Is there a way to delete that?
Apple changed a ton of stuff with Time Machine in recent operating systems like Catalina and Big Sur, so this may or may not be possible. You can always erase the Time Capsule drive to wipe everything off and start again if that would work, which will only take a few minutes.
If that is not acceptable, we can try to go through the steps to erase only the backup(s) that you don't need anymore, but there are no guarantees on success with the newer operating systems. Recently, using my Mac running Big Sur, I tried to delete an old Time Machine file on the Time Capsule that I no longer needed. Nothing but error messages when I tried this multiple times.