Just to be perfectly clear here... this really is a first generation M1 Mac computer. It is expected to have issues. It is also really a first generation OS for said device (Big Sur), so it too, is expected to have issues.
Not trying to say Apple shouldn't have tested the devices more before actually releasing either, just pointing out that when you are buying a first generation anything, you are basically buying a device with many unknowns attached to it. It's not the same as buying one of their INTEL Mac computers which have over a decade of iterations under the belt.
Many of the try this and try that adapter merry go round has been more an effort on the user's part to try and get a device to work as expected on an INTEL Mac... come to find out, many of the issues had to be fixed in Big Sur by Apple. So it was never the cable or the adapter for many... it was the OS. It may still turn out to be a limitation with how the hardware was implemented for others. Whether that means Apple is going to fix it in the next iteration of M1 type Macs or do some sort of return, we don't know yet.
The reality is, everything that went wrong with those who adopted the M1 Macs early, is a wealth of information and knowledge for Apple to use for improving the device. The devices will only get better. It's a painful road for the early adopters, but a year or two, these things are going to be much better than they are today because of early adopters.
You're all pioneers. And as pioneers, you get to be the first to own one and help with the molding of it's future with every little thing you learn about it along the way. Apple can't possibly test every possible piece of hardware that can be attached to it, nor can it test how people will use it... that's where you all come in. We all come in. We are the world's largest test group in the world... it's like we make up the super-computer of testing... we have the ability to find things that Apple didn't in less time than it would have taken them to find them.
Apple certainly didn't attempt to connect 6 displays to an M1 Mac... but some intrepid M1 pioneer did. Just saying you are all pioneers at this point. The safety net is in the INTEL Mac lineup because over a decade of pioneering has made them pretty **** stable/predictable... and it is that history that has a loyal Mac base behind it. The M1s are going t get there... just not right out of the gate.