Hey there, briggsaj.
After reviewing your post, it appears that your AirPods aren't remembering that you don't wish to use Siri. I'm happy to help.
Get help with your AirPods -- Unpair the iPhone from the AirPods. Tap Settings > Bluetooth and tap the icon next to your AirPods. Then tap Forget This Device.
Restart your iPhone, iPad, or iPod touch -- Then, restart your iPhone. Once it's returned to the Home screen, pair your AirPods with your iPhone and test the issue.
Let me know how that goes.
Take care!