iphone 4 stuck on Apple Logo

Hello. I have an old iPhone 4 that I recently tried to update to ios 7.1.2. (Yes I know I'm late to the party). I did it over wifi stupidly. Now it it stuck on the Apple logo. I did some research on this problem and people have said do a hard reset and that should fix it. I did that about 5x and it still stuck on the Apple Logo. Then I saw a thread that said I have to put the iPhone in recovery mode and reset from factory settings. Ok I did that about 3x and every time it comes back and stuck on the Apple Logo. I dont understand how to fix this. The weird part of this is that when I plug it into my computer iTunes recognizes the iPhone after recovery mode but the phone itself in stuck on the Apple Logo. Please kindly help me. Thank You.