VPN not working outside of local network
I am running the OS X Mountain Lion server. I also have Verizon FiOS as my ISP. I can see the wiki, install my profiles to my devices, and most of everything that I have enabled seems to work, except VPN. I turn it on, configure my FiOS router to forward the ports: 500, 1701, 1723, and 4500, which I found on this page. If I try to connect my iPad Mini (WiFi only, iOS 7) to my VPN server, it will try to connect for a few seconds and then give me an error (see below). If I connect to my local network and change the server to the IP address of my server, it will connect just fine. If I try with my server's domain outside of my network, I jut get that error. My server's VPN log does not show any connections when done outside of my local network. When done locally with the local IP, it works just fine and I see the log has more info about devices connecting. I'm wondering if it is just me making a simple mistake or if FiOS is blocking the ports needed.
Here is the error that I am getting:
OS X Mountain Lion (10.8.5)