problem with AirPods one ear or the other losing connection repeatedly

I have had increasing problems with my airpods where suddenly one ear will lose connection, or when I start up one of the ears loses connection. I then have to go through the steps of disconnecting, forgetting that device, restarting (holding button down on back of case), then reconnecting. I have to do this over and over when I am using them. What am I doing wrong?