It appears my wifi adapter on my new retina macbookpro is falling asleep if not used at an interval of less than a second. I think this is exactly the latency issue i've been seeing when connecting to remote terminals. The more remote shells I run the less this seems to be an issue. However one remote ssh connection is not enough to keep the wifi adapter from going into some sort of sleep mode. Below are the results of pinging at a 0.2 sec (200ms) interval vs pinging at a 1s (1000ms) interval.
ping -i 0.2 192.168.1.1
PING 192.168.1.1 (192.168.1.1): 56 data bytes
64 bytes from 192.168.1.1: icmp_seq=0 ttl=64 time=38.522 ms
64 bytes from 192.168.1.1: icmp_seq=1 ttl=64 time=1.136 ms
64 bytes from 192.168.1.1: icmp_seq=2 ttl=64 time=1.149 ms
64 bytes from 192.168.1.1: icmp_seq=3 ttl=64 time=1.075 ms
64 bytes from 192.168.1.1: icmp_seq=4 ttl=64 time=1.156 ms
64 bytes from 192.168.1.1: icmp_seq=5 ttl=64 time=1.025 ms
64 bytes from 192.168.1.1: icmp_seq=6 ttl=64 time=1.139 ms
64 bytes from 192.168.1.1: icmp_seq=7 ttl=64 time=1.166 ms
64 bytes from 192.168.1.1: icmp_seq=8 ttl=64 time=1.195 ms
64 bytes from 192.168.1.1: icmp_seq=9 ttl=64 time=1.059 ms
64 bytes from 192.168.1.1: icmp_seq=10 ttl=64 time=1.133 ms
64 bytes from 192.168.1.1: icmp_seq=11 ttl=64 time=1.065 ms
64 bytes from 192.168.1.1: icmp_seq=12 ttl=64 time=1.605 ms
64 bytes from 192.168.1.1: icmp_seq=13 ttl=64 time=1.638 ms
64 bytes from 192.168.1.1: icmp_seq=14 ttl=64 time=1.224 ms
64 bytes from 192.168.1.1: icmp_seq=15 ttl=64 time=1.076 ms
64 bytes from 192.168.1.1: icmp_seq=16 ttl=64 time=1.026 ms
64 bytes from 192.168.1.1: icmp_seq=17 ttl=64 time=1.169 ms
64 bytes from 192.168.1.1: icmp_seq=18 ttl=64 time=1.128 ms
64 bytes from 192.168.1.1: icmp_seq=19 ttl=64 time=1.760 ms
64 bytes from 192.168.1.1: icmp_seq=20 ttl=64 time=1.112 ms
64 bytes from 192.168.1.1: icmp_seq=21 ttl=64 time=1.051 ms
64 bytes from 192.168.1.1: icmp_seq=22 ttl=64 time=1.255 ms
64 bytes from 192.168.1.1: icmp_seq=23 ttl=64 time=1.055 ms
64 bytes from 192.168.1.1: icmp_seq=24 ttl=64 time=1.117 ms
64 bytes from 192.168.1.1: icmp_seq=25 ttl=64 time=1.173 ms
64 bytes from 192.168.1.1: icmp_seq=26 ttl=64 time=1.126 ms
64 bytes from 192.168.1.1: icmp_seq=27 ttl=64 time=1.289 ms
64 bytes from 192.168.1.1: icmp_seq=28 ttl=64 time=1.153 ms
64 bytes from 192.168.1.1: icmp_seq=29 ttl=64 time=1.255 ms
64 bytes from 192.168.1.1: icmp_seq=30 ttl=64 time=0.975 ms
64 bytes from 192.168.1.1: icmp_seq=31 ttl=64 time=1.114 ms
64 bytes from 192.168.1.1: icmp_seq=32 ttl=64 time=1.672 ms
64 bytes from 192.168.1.1: icmp_seq=33 ttl=64 time=1.598 ms
64 bytes from 192.168.1.1: icmp_seq=34 ttl=64 time=1.153 ms
vs
ping -i 1 192.168.1.1
PING 192.168.1.1 (192.168.1.1): 56 data bytes
64 bytes from 192.168.1.1: icmp_seq=0 ttl=64 time=259.458 ms
64 bytes from 192.168.1.1: icmp_seq=1 ttl=64 time=180.414 ms
64 bytes from 192.168.1.1: icmp_seq=2 ttl=64 time=100.878 ms
64 bytes from 192.168.1.1: icmp_seq=3 ttl=64 time=22.095 ms
64 bytes from 192.168.1.1: icmp_seq=4 ttl=64 time=249.786 ms
64 bytes from 192.168.1.1: icmp_seq=5 ttl=64 time=170.507 ms
64 bytes from 192.168.1.1: icmp_seq=6 ttl=64 time=91.480 ms
64 bytes from 192.168.1.1: icmp_seq=7 ttl=64 time=11.999 ms
64 bytes from 192.168.1.1: icmp_seq=8 ttl=64 time=1.183 ms
64 bytes from 192.168.1.1: icmp_seq=9 ttl=64 time=160.052 ms
64 bytes from 192.168.1.1: icmp_seq=10 ttl=64 time=79.727 ms
64 bytes from 192.168.1.1: icmp_seq=11 ttl=64 time=1.630 ms
64 bytes from 192.168.1.1: icmp_seq=12 ttl=64 time=35.497 ms
64 bytes from 192.168.1.1: icmp_seq=13 ttl=64 time=1.881 ms
64 bytes from 192.168.1.1: icmp_seq=14 ttl=64 time=69.822 ms
64 bytes from 192.168.1.1: icmp_seq=15 ttl=64 time=106.626 ms
64 bytes from 192.168.1.1: icmp_seq=16 ttl=64 time=130.952 ms
64 bytes from 192.168.1.1: icmp_seq=17 ttl=64 time=137.781 ms
64 bytes from 192.168.1.1: icmp_seq=18 ttl=64 time=58.795 ms
64 bytes from 192.168.1.1: icmp_seq=19 ttl=64 time=204.236 ms
64 bytes from 192.168.1.1: icmp_seq=20 ttl=64 time=207.971 ms
64 bytes from 192.168.1.1: icmp_seq=21 ttl=64 time=1.166 ms
64 bytes from 192.168.1.1: icmp_seq=22 ttl=64 time=48.795 ms
64 bytes from 192.168.1.1: icmp_seq=23 ttl=64 time=276.781 ms
64 bytes from 192.168.1.1: icmp_seq=24 ttl=64 time=197.100 ms
64 bytes from 192.168.1.1: icmp_seq=25 ttl=64 time=118.236 ms
64 bytes from 192.168.1.1: icmp_seq=26 ttl=64 time=38.446 ms