Delay in playing audio when connecting Mac M1 Air with AirPods Pro

When I am connecting AirPods Pro with Mac M1 Air the video starts playing but it take about 5 to 10sec until I start hearing audio. I have noticed that I am able to hear the connected sound from AirPods. Also if the audio was playing through speaker then the audio stops playing and I am not able to hear anything for sometime. I have used AirPods with MacBook Pro 16-inch and iPhone and there if no delay in audio getting through. Has anyone faced this issue with MacBook Air M1 and AirPods Pro?