Delete photos from Apple TV

Here is my situation.

When I go to the ”photos” app on the Apple TV 4K, I then select “Albums” and then “All Photos”. From there I am seeing many photos that had I deleted from my iPhone several months up to a couple of years ago. Everything that I have seen in forums is that you can long press select the photo within the photos app and delete it that way from the device, but that doesn’t work. If I have deleted them from my iPhone and I can’t delete them from the Apple TV, where else can I go to delete the photos? It is almost like there is a different collection of photos I have taken on my iPhone on each device, saved photos and deleted ones.

Thanks