Should I charge a new Apple Watch SE before setup?

If the device is new out of the box, it might have been in storage for a while and you do not want the battery to run out in the middle of the setup. So yes, make sure both the watch and iPhone are charged before doing the setup.

Typically Apple Watch shipments from Apple in a brand new, factory sealed box arrive with enough charge to set up the Apple Watch first.

It cannot hurt to charge it first, but that may not be required.

Recommended you set up the apple watch after charging for a while.

By the way, charging the watch before setting it up will not take very long. I have a Series 11 watch and it charges up to 80% from close to zero in less than 30 minutes.