Have you tried a Hard Reset of the device, not sure of your model but this article should help, the section you want is towards the bottom.
How to Reset an iPhone (All Models)
When the unit restarts you will need to enter your password and that’s it - see if the phone now looses less charge in general use.
Another thing you can do is take a look at the Battery Usage section (my iPad’s is below).
When fully charged and you disconnect, if you don’t use your device expect Usage to be about 1 to 2 min per Standby 1Hrs. The area above “Time Since Last...” breaks things down a little so you might see wants using the most battery even when it’s just sitting around.