How do I setup a 5th Generation Apple TV without a Siri Remote?

I have a 5th generation Apple TV and I lost the Siri remote. I was having issues updating to the latest tvOS so I thought a hard Reset would be in order. Unfortunately that meant I lost my connection as the remote was through the remote app on my iPhone and not the Apple TV Siri remote. Since the Apple TV wasn't on Wifi, my iPhone had no way of connecting. I tried connecting through an XBox game controller via bluetooth, but that didn't work either.

I scoured the internet for an answer and the most helpful response I found was from 2014 on these forums. They said to plug in the Ethernet cable from my router. Voila, that solved the issue (or so I thought). My Remote app on my iPhone was able to connect at that point and then I could pair it as directed by the Apple TV instructions with the remote app on my iPhone.

After getting it paired I was able to control the Apple TV. But now I'm reliant on the Ethernet cable. I can't setup WiFi with the ethernet cable connected. But if I disconnect the Ethernet, my iPhone remote loses it's connection. How can I get my Apple TV back on Wifi?