How to stop my AirPods from sharing my location without my consent?

Today, I was out with my wife, in the evening my wife told me that her iPhone sent her tracking of my AirPods Pro showing all locations we’ve visited today. I checked find My , and found that I have disabled sharing location. So, why my AirPods Pro is sharing my location to my wife?

[Re-Titled by Moderator]