Sleep focus not silencing notifications

I’ve tried the “allow only for” and “silence notifications from” configuration in Sleep focus, but neither work to stop my Apple Watch vibrating during sleep, but neither work.

The watch is in Sleep mode, checked in control center. And when I’m not wearing the watch, notifications are silenced on the iPhone.

Lately I’ve had to take it off or put it manually in Do Not Disturb, but then it doesn’t track my sleep.

I’m running Watch OS 10 and iOS 17 public betas, but this is NOT a new issue, it happened with watch OS 9 and iOS 16 too.