While the Memories feature itself cannot be fully disabled, you can turn-off any associated Notifications from iPad settings:
Settings > Notifications > Photos > Customise Notifications > Memories - set to OFF
Apple does invite submission of comments and feature requests via its Product Feedback portal. For iPad and iPadOS:
Feedback - iPad - Apple
If you would like to see adjustments or changes to existing functionality in a future version of iPadOS, this would be the most appropriate channel through which to make a request - along with any associated reasoning. While you may not receive an individual reply, it is understood that all feedback is logged/analysed and fed-back to the relevant teams within Apple.