iCloud library won't download on phone

So I got a new iPhone (the iPhone X 64 gb to be specific), and all my icloud photos downloaded within an hour of me logging into my iCloud. Afterwards, I was messing around with some of the photo settings (stupidly), and turned off the iCloud Photo Library on the new phone. I was prompted that all of my photos would still be on iCloud and be available for resyncing and download. However, my photos still won't download. I have a random 100 or so of them, but nothing compared to the 350 I originally had. The status in the Moments tab is stuck on "Updating..." and won't download anymore photos. My phone has been off low power mode every night and connected to a WiFi source. Is there anyway to get my photos back without resetting the phone?