I would say that this could be a good thing, we see the battery logo on the screen only when the phone is normally switched off, try turning it on like you always do and see if it turns on normally. Or you can follow the steps.
1. Turn on itunes.
2. Use fixrecovery ( its simpler and yields better output than tinyumbrella ) by downloading fixrecovery & zlib1.dll and saving these two files in the same folder.
3. Open command prompt and navigate to the location where you have saved fixrecovery executable.(For eg : C:/)
4. Now run fixrecovery (For eg : C:\>fixrecovery.exe).
5. It will prompt you to put your phone in DFU mode if you arent already in it.
6. If it does Press and hold power and home button for 10 seconds, then release only power button and continue holding the home button for another 10 seconds or until you see that fixrecovery has started executing.
7. Remember that if you release any of the power or home button in between the above steps while putting your phone to DFU mode, even for a split second, your phone will enter recovery mode and not DFU.
Let me know if it works for you