The timing of my call and being within the return window likely helped me, along with getting to a senior advisor on the call. I contacted Apple right away when I noticed the issue, and they opened a case re the problem. At the time, three things were going on -- the pixel shift, blurry text and the monitor dropping back from 5K to 4K. I effectively had tried everything (software updates, restarts, different cables and ports) the Level 1 support agent would ask me to do, so I was able to get to a senior advisor during the call.
I told them I wanted to avoid sending anything back if I can avoid it, so the case was left open and got assigned to the next level of support for more advanced diagnostics. Apple was now contacting me to resolve the issue, and I have been working with the same technician for several weeks. I've run a number of different diagnostics routines at their direction and even sent a video shot from my phone showing the pixel shift. The blurry text and falling back to 4K were resolved with Big Sur 11.1 update. Since the pixel shift its still present after the update, they initiated a replacement that I am waiting to ship.
If you are correct with it being an architecture issue, the replacement Mini won't by itself resolve the pixel shift issue. I'm at the point though that I'll have to live with it and hope that it will be fixed with a firmware or software update.
Best of luck.