Help please, battery not charging but it's connected?!

Got an iPhone 4 with iOS7.

Just installed a new battery and when I plug it in it says it's connected but the percent doesn't go up at all, it goes down!

Please can somebody help, I don't know why it's not charging when it says it is?

Thanks very much. (Kind of urgent as it's slowly draining)