Try this first - Reset the iPad by holding down on the Sleep and Home buttons at the same time for about 10-15 seconds until the Apple Logo appears - ignore the red slider - let go of the buttons. (This is equivalent to rebooting your computer.)
The quickest way (and really the only way) to charge your iPad is with the included 10W or 12W (5W on Mini) USB Power Adapter. iPad will also charge, although more slowly, when attached to a computer with a high-power USB port (many recent Mac computers) or with an iPhone Power Adapter (5W). When attached to a computer via a standard USB port (2.5W, most PCs or older Mac computers) iPad will charge very slowly (but iPad indicates not charging). Make sure your computer is on while charging iPad via USB. If iPad is connected to a computer that’s turned off or is in sleep or standby mode, the iPad battery will continue to drain.
Apple recommends that once a month you let the iPad fully discharge & then recharge to 100%.
How to Calibrate Your Mac, iPhone, or iPad Battery
At this link http://www.tomshardware.com/reviews/galaxy-tab-android-tablet,3014-11.html , tests show that the iPad 2 battery (25 watt-hours) will charge to 90% in 3 hours 1 minute. It will charge to 100% in 4 hours 2 minutes. The new iPad has a larger capacity battery (42 watt-hours), so using the 10W charger will obviously take longer. If you are using your iPad while charging, it will take even longer. It's best to turn your new iPad OFF and charge over night. Also look at The iPad's charging challenge explained http://www.macworld.com/article/1150356/ipadcharging.html
Also, if you have a 3rd generation iPad, look at
Apple: iPad Battery Nothing to Get Charged Up About
Apple Explains New iPad's Continued Charging Beyond 100% Battery Level
New iPad Takes Much Longer to Charge Than iPad 2
Apple Batteries - iPad http://www.apple.com/batteries/ipad.html
iPhone: Hardware troubleshooting (Power/Battery section also applies to iPad)
Extend iPad Battery Life (Look at pjl123 comment)
New iPad Slow to Recharge, Barely Charges During Use
iPad: Charging the battery
Best Practices for iPad Battery Charging
Tips About Charging for New iPad 3
How to Save and Prolong the battery life of your new ipad
Prolong battery lifespan for iPad / iPad 2 / iPad 3: charging tips
iPhone, iPod, Using the iPad Charger
Install and use Battery Doctor HD
To Extend a Device’s Battery Life, Get to Know It Better
iPad Battery Replacement
In rare instances when using the Camera Connection Kit, you may notice that iPad does not charge after using the Camera Connection Kit. Disconnecting and reconnecting the iPad from the charger will resolve this issue.
I am facing a similar problem, my batt was low at 4%. I didn't use the iPad for some days and then when i kept it to charge it would just go on and off. It kept showing the apple icon. When it came on while being connected to the charger, it showed 85% charged. The moment I removed the charger the ipad went off, completely. As if the battery never charged at all. It just won't come on. I tried connecting it to the charger again, then it powered up, but the moment i switched off the adapter it went completely off again. when connected to the carger it comes on and then after 4-5 mins restarts again. I have tried the Home and Sleep button method to reset the Ipad, but no use. when i connect to my computer, it just shows the apple logo and then the dead red batt icon and keeps repeating the same thing again and again. Can someone HELP!!! The Ipad is out of warranty. If at all i can only replace it at a cost