I use an Nvidia GTX 680 2GB, a second hand card that I bought 2 years ago.
The drivers for the GTX 680 are built in to the OS, later model Nvidia cards may not
work because of the ongoing feud between Apple and Nvidia so there may be no
driver support for later model cards.
Also look for Mac Edition cards or 'flashed for Mac' cards, these include the Apple EFI
which gives you the Apple boot screens and access to the Startup Manager.
PC, (Non Mac Edition or non flashed) cards are often cheaper but do not give you the boot
screens, the Mac boots directly to the login screen or Desktop whichever is set. You will not
get the Startup Manager when requested on startup. The cards will work perfectly well.
A very popular choice at the moment is the Sapphire Radeon RX580, it is also new as
opposed to second-hand. There are some places which will flash your RX580 for
you, which means you sending it to them and paying about $100 for the service.
Graphics cards can become very expensive so look for one that you know will fit your needs.
The more expensive cards with large RAM are expected to be used for HD video editing
or 3D modelling, so if you do not do those sort of tasks on your Mac there is no point
in spending hundreds of dollars/ pounds etc.
You will also need to get a card that has the correct out put for the displays you are
connecting to. The GTX 680 has two DVI, one HDMI and one Displayport.
It may be worth your while asking this question on the Mac Pro Community here
to see if you can gain any more information from fellow Cheese Graters.
https://discussions.apple.com/community/desktop_computers/mac_pro