Agreed, eGPUs are probably a bad idea if you have a computer with real PCIe slots. Not only are those limited to PCIe x4 per thunderbolt bus but the thunderbolt protocol also adds a little extra latency. Rob with Barefeats.com demonstrated that direct PCIe host-card-to-expansion-box solutions work much better. https://barefeats.com/mac-pro-2019-na255a-pcie-expansion.html
Anyway, the 2019 Mac Pro has the following limits:
- 4x 8-pin AUX power connectors (+1x 6-pin)
- 8x PCIe slots (7x full length, 4x double width)
- 64 PCIe lanes for cards (2x lanes with x16, other 6x slots share 32-lanes via a PCIe switch)
Each MPX modules uses 2x 8-pin AUX connectors limiting you to 4x GPUs if using Vega II Duo modules.
If you bring your own cards you are limited to 4x 225W 1x-8-pin double-width cards, or maybe 8x 150W 1x6-pin single-width half-length cards. (Disclaimer: Apple only advertises 4x GPU support so there might be a limit to how many MacOS can recognize).
For full official technical specs see the white paper. https://www.apple.com/mac-pro/pdf/Mac_Pro_White_Paper_Feb_2020.pdf
For even more cards (or cards with more power) PCIe expansion enclosures are the only way to go. Theoretically If you populated every full-length PCIe slot with an adapter card you could run 29x PCIe devices each at either 3.0x2 or 3.0x4 speeds, but again MacOS limits might kick in earlier.