I could get a few minutes as well. Restart happened after maybe 2 or 3 minutes.
In my case, I'm pretty sure it was Optimal Layout. I've quit that and haven't had the issue. Looks like there are a lot of different apps that are causing this behavior in Sierra. (From the ShiftIt github issues page it looks like perhaps Sierra changed things wrt fullscreen apps.)
@vibaza, Try going through your apps and quitting everything (including things that don't show up in the dock or even the menubar; check the startup items as well), then try fullscreen video and re-add apps until it tanks. That's what I'll be doing if I'm wrong what's causing it for me.