If you have upgraded your client, you need to upgrade your admin as well; it's simple as that. Trying to downgrade is not a good idea any better than downgrading 10.4.8 to 10.4.7 - you're better off backing up and re-installing.
You should upgrade your client at the same time as your admin by using the 3.1 admin updater. It will keep the two in sync. If you have updated your client separately, it's time to update the admin as well.
Since 3.1 is an updater, if you are trying to setup ARD 3.0 (as a new admin machine) which has already been updated to 3.1 client, you will get an error about the client being too new. You need to do this:
Right-click the ARD 3.0 installer package.
Navigate to Contents > Installers
Run the Admin and RMDB installers, but not the client (it's the one that's preventing the ARD 3.0 super-installer from wanting to install)
Now update to ARD 3.1.