I assume that you meant HDMI and DisplayPort, not HDMI and “Port Display.”
No, there is no need to install the DisplayLink driver. That is for a workaround whose name (DisplayLink) sounds similar to DisplayPort, but which is not the same as DisplayPort.
Your Mac outputs DisplayPort video over uSB-C and Thunderbolt, and can drive up to two external monitors in a first-class, hardware-accelerated way. (One each off different USB-C ports, or two off a Thunderbolt dock.). No drivers needed.
You just need a USB-C to DisplayPort adapter cable, USB-C to HDMI adapter cable, or hub/dock that has a dedicated DisplayPort or HDMI port driven off hardware video output. The adapter cables are a dime a dozen on Amazon and similar places. So are inexpensive (non-Thunderbolt( hubs that can drive a single HDMI monitor.