I did not want to criticise your question - sorry, if you misunderstood my comment.
Your example about presenting an "Easter" memory to you is a very good example to justify a request for a removal. But "offensive", "intrusive", "ugly" could profit from more detailed examples as well, as Apple is currently giving the memories so much priority and will need convincing.
I already sent feedback to Apple using the feedback Assistent. My problem with some of the automatically created memories is, that they can be very hurtful - memories are meant to surprise us with long forgotten photos and to bring back fond memories of old times. But sometimes Photos will pick photos, we cannot stand to watch at the time they are presented out of the blue, for example, when we are in mourning.
And I find it disrespectful, that Photos is cropping our Photos and tiling them. I am spending hours composing the perfect leading lines into a photo, placing the horizon and points of interest, taking care, not to cut off the hands and feet of people in the photos, or the tops pf towers, balancing the light and color. And Photos is spoiling all my artistic work by cropping the photo, so some stranger in the background will be placed at the point of interest, cutting away the tops of church towers or the feet of a person. I hate to see my photos tiled and crippled in the Memories or Days. Sometimes I cannot even recognise a photo I have been looking for.
I just think, giving details of what we find offensive, painful, ugly would help to make the Apple Developer team understand the problems.