Any use replacing the battery in a old iPhone?

Apple does not sell iPhone parts including batteries. You have forfeited your ability to have the battery replaced by Apple by doing it yourself. They will no longer service your phone.

90%+ of the batteries you can buy out there are crap. It's not a matter of planned obsolescence, You could have had one that worked perfectly fine if you had gone to Apple in the first place.

Sorry. You can try again with a battery from another vendor and maybe have more luck. By the time it's all said and done, it would have been cheaper to pay Apple the $70 to replace the battery for you to begin with.

Stay away from those High Capacity batteries. They are utterly awful!

There are decent batteries available, but they are such fickle things. You definitely have a dud... especially if it's a high capacity one.

is there any use changing battery in old iPhones

Yes, I am constantly replacing them (successfully). As are Apple.

Apple will replace the battery in an out of warranty iPhone for about $70.

Once you open the casing of the phone yourself, or have it done by an unauthorized service provider such as SunOfRa78 above, you forfeit all rights to service by Apple. They won't touch it.

Those high mAh batteries are notoriously bad. Just get a new standard 4s battery from someone who will warranty the part they sell. Should cost about $10 USD and yes, this is a very reasonable thing to do.

Don't forget to mention that You stand to profit from the promotion of 3rd party unauthorized service, and that doing that permanently forfeits all rights to any service from Apple. Oh, and the fact that it is impossible to legitimately obtain new genuine Apple parts. All parts available for iPhones from unauthorized parties are either salvaged, stolen, or counterfeit.

You can do whatever you want. At this point, your only real options are to do it yourself or have a 3rd party do it for you, or to go buy a new phone. Apple, Sony. I honestly don't care.