I have a MacBook Air (2020 M1 Chip) and want to use two or three monitors in extend mode. Can this be done and if so, how?

As the specs say for your model computer, the M1 chip Mac only supports one external display.

Not natively, your Mac supports only one external display. There are 3rd party solutions involving DisplayLink hardware, not optimal but may work.