The Airport Express is a router/wireless base station, similar in function to the one you have now. See:
http://www.apple.com/airportexpress/
Whether or not an AE would be better than the router/base station you have will depend on why it is you're having problems. If your current router is defective, replacing it would probably help. If, however, the signal is weak and dropping out because of the distance from the router and/or parts of your house (masonry, metal, etc.) blocking the signal, than another router may not be any improvement.