AirPods disconnect from Mac, require re-pairing

While listening to music or watching a video on YouTube my AirPods will disconnect from my Mac completely, to the point where the only way I can reconnect is to hold the button on the case and connect to the Mac like it's the first time over and over, this doesn't happen when connected to my iPhone and none of my other bluetooth devices (keyboard and mouse) disconnect. Also every time I reconnect I choose the Connect to this Mac->When last connected to this Mac option.