Macs will not drive two displays over a plain USB-C dock. If you want to drive two displays from a dock, using hardware-supported video output, it will need to be a Thunderbolt dock. Other World Computing, SonnetTech, and CalDigit all sell such docks.
As for driving two external monitors and the built-in display at the same time, the Technical Specifications for both M4 MacBook Airs indicate that this is possible. Note: M4. The M1, M2, and M3 MacBook Airs cannot do this.
MacBook Air (13-inch, M4, 2025) - Tech Specs - Apple Support
MacBook Air (15-inch, M4, 2025) - Tech Specs - Apple Support
"Simultaneously supports full native resolution on the built-in display at 1 billion colors and:
- Up to two external displays with up to 6K resolution at 60Hz"