How do I get my AirMac Express to work

I am not able to get my airmac express to work. I used airport utility to configure the unit. Entered all the information and, believe it was successful, as the light turned green but in the airport utility screen the upper portion that shows the network globe shows a yellow light and, when the globe is pressed, the pop up window reads "connection Disconnected" but I have confirmed that the internet is working as I connected the ethernet cable directly into my laptop and got it to work (using now to send this post). So I confirmed that internet is working, I have a green light on airmac express, but when I try to use my laptop with wi-fi I cannot get the internet to work. As for the model information, I just purchased the airmac express (802.11n) from the apple store today (i.e. latest model) and I am using both an macbook air (1 year old) running 10.9.5 as well as a macbook running 10.9.3. One other piece of information, when I start safari and press the "Network Diagnostics" button in the window I get green lights for Wi-FI, Wi-Fi Settings, and Network Settings, but have red lights for ISP (failed), internet (failed), and server (failed)

Any ideas?

Thanks