Unable to use single AirPod with Apple Vision Pro

I am encountering an issue with my AirPods Pro 2 (USB-C) where I cannot use just one with my Vision Pro. When I try using both AirPods at the same time, I have no problems.

I have already tried resetting and re-pairing the AirPods multiple times, and both devices are on their latest software versions.

Any help would be greatly appreciated!

-Dallen