M1 external USB-C DAC audio "stutter" during high CPU load

After switching from x86_64 to ARM-based MacBook Pro audio started to periodically stutter when CPU usage abruptly jumps: Chrome opening complex page, Docker, etc.

This is only true for bursty CPU usage spikes, a sustained load like `openssl speed -multi 8` does not cause stuttering.

PS. Setup was exactly the same between old and new mac: same OS version, same DAC, same, cables, same MIDI Setup, etc.

PPS. This is a quite common issue on forums, with Apple not really providing a useful answer:

M1 iMac audio "stutter" - Apple Community

MacBook Pro M1 Max HDMI outputting stutte… - Apple Community

etc..