Hello Jmonac,
It sounds like you don't have your Apple TV remote and are unable to set up the Apple TV Remote app because your Apple TV is not connected to Wi-Fi. Is that right?
This resource covers how to Set up the Apple TV Remote on your iPhone or iPad:
"If you can't set up the Apple TV Remote
Try these steps. After each step, see if you still need help.
- Check that your iPhone or iPad is on the same Wi-Fi network as your Apple TV or AirPlay-compatible smart TV. On your iOS or iPadOS device, go to Settings > Wi-Fi. On your Apple TV, go to Settings > Network.
- Make sure that your iPhone or iPad is updated to the latest version of iOS or iPadOS, and your Apple TV is updated to the latest version of tvOS.
- Restart your Apple TV or AirPlay-compatible smart TV. Also try restarting your iPhone or iPad.
- If you still can't set up the Apple TV Remote, contact Apple Support."
Based on the above, you would need to have both the iPhone and your Apple TV connected to the same Wi-Fi network. In this case, you'd need to locate the physical remote in order to connect your Apple TV to Wi-Fi. This may help: If you lost the remote for your Apple TV - Apple Support
Thanks!