Dark mode affecting the dynamic desktop

I recently find that when I change to the dark mode, my dynamic desktop will be changed to the night version automatically no matter when it is. I believe this is not the case when Mojave came out, and I remember that I can change into the dark mode while the dynamic desktop is still at dusk or something. Is my memory wrong or is there an update on this issue?