It could be interference, either from other devices such as cordless phones, or other WiFi networks nearby. You can try changing the channel of your router. Use a channel other than 6 or 11, which are the defaults for most routers.
Also, WHEN does the connection go in and out? While you are using it, or while it is asleep (which is normal)?