Trying to use emergency bypass on my phone with an apple watch connected

I am on call frequently for work and we use Pager Duty for notifications. It will send us a text anytime there is something we need to work on. Previously, I saved the Pager Duty contact and set it up with it's own ringtone and enabled Emergency Bypass. That way, I can have my phone on silent and while still getting the ringtones for Pager Duty.

I got an iWatch recently and discovered the Emergency Bypass is no longer working. I tested it and when the watch is connected, neither it or my phone play the ringtone for Pager Duty. If I turn off the watch though, the Emergency Bypass works fine.

Is there any way I can get this to work? I really don't want to keep my phone off of silent mode all the time, that defeats the purpose of the Emergency bypass.