Can I find my phone with iCloud even if its offline (shutdown)?

No. iPhone needs to be turned on and connected to Internet

to use Find My to find it. In addition, Find My must have been

turned on previous to the iPhone becoming lost.

It depends on the model. Some newer models can still be found while powered down for a limited amount of time.