Accidentally disabled iCloud Photo Library. Enabling it back causes Photo to reupload all my photos to iCloud again.

So I was checking my iCloud setting earlier today. I noticed that instead of the usual checkboxes, the Photo app has a dash character instead. I figured I can probably expand it to see more options so I clicked it. Well, clicking this disabled iCloud Photos Library.

I quickly enabled it back. Check my Photo setting and to my horror Photo is trying to reupload all my photos AGAIN

Am I screwed? I would have thought the app and iCloud are clever enough to determine which photos are already in the cloud.