I think that what you are saying here is historically true. However, Apple's implementation for driving external displays on the M1 architecture is currently nothing short of dismal. Not only are there endless issues with driving displays reliably, alongside repeated crashes, incompatibilities with DisplayPort 1.4 and intermittent kernel panics, Apple itself has acknowledged unresolved issues and we are still waiting for a formal resolution.
For people within the M1 ecosystem, it is reasonable then to assert that the DisplayLink suite of products may actually be a superior option when compared to the issued faced by using Apple's own implementation.
I, historically, have been extremely critical of DisplayLink due to its noticeably inferior performance, however, as someone who has essentially lost the last two months of productivity due to Apple's disgusting excuse for a "standard for graphics performance" my only two options are to repurchase an Intel MacBook or use a third-party DisplayLink solution.
It is the best solution of a bad range of options, but still a solution.