Continuity Camera freezing during Zoom calls, just started this week - what is causing this?

I've been using my iPhone 13 mini as my webcam (wired in using a USB-C to Lightning cable straight into the MBP) for the past month on my 16 inch M1 Pro MBP with Ventura and it has been working really well for the most part. I have the M1 going into a 4K monitor and the iPhone is mounted on the top of the monitor. For some reason, it has now started freezing during calls and takes a minute to come back up. I have done the following to troubleshoot:

1. I have fully reset the iPhone 13 mini to factory settings (full erase) and this did not work.
2. I have updated both the iPhone and Mac to the most current OS (As of this time iOS 16.2 and Ventura 13.1) and this has not worked.
3. Zoom is updated to the newest stable release. I use Zoom for work and it is the only program I need a webcam for.
4. It is in the correct position and meets all the requirements to activate, it just freezes randomly.

Any idea what is causing this now?