Can I use two of Apple USB-C Digital AV Multiport adapters to connect a macbook pro to two external monitors? I am having issue with that for some reason.

What model/year MacBook Pro?

If it is a M1 MacBook Pro then only one external monitor can be connected.

Yes, if you have an M1, you'll only be able to natively support one external monitor in addition to the screen on the laptop. There may be a workaround if you do some research though.

Good luck.