Either internet connection or printer. No both.

I'm having an issue where I can either use my USB printer or my internet, but not both. The first one I use after start up will work, but that causes the other not to. For instance, if I restart my computer and print a page, the printer will work flawlessly, but if I try and use the internet it will just spin and never connect. Likewise, if I use the internet first upon startup it will connect just fine, but if I try and print after that the printer dialog box will just say "connecting" without ever connecting.

It seems my airport extreme is not routing the signals properly. What can I do about this?