remove photos from generated memories video albums

Hi, my dad passed away in 2022 and I took a photo of the open casket to remember that day on my terms when I need to see his face and mourn that day. The problem is that the memories album keeps adding my dad’s photos of his funeral to the memory album, I remove them and it’s put back there again and again. Imagine running a memory album and seeing happy memories with music then the face of your dead dad, emotions are thrown all over the place. Is there a solution to this ? Will hiding the photos in hidden photos will do the trick? But i don’t necessarily want to file it under hidden photos…does anyone know how are these memories generated ? Is it IA or apple services ? Are photos private ?