Charged iPod shuffle 4th Gen keeps telling "Battery low"

I have just charged my iPod shuffle since it hadn't been charged for like years with the iPhone power brick and the iPod's charging cable. At first when I connected the iPod with my MacBook, it showed that the iPod was fully charged after a whole afternoon charging. But when I plugged in my earphones and used it, the iPod said "Battery low" and then shut down completely after a few minutes playing music. I tried to factory reset it for like 2 times and it didn't really help. Have anyone been through this? Please help me because the iPod means a lot to me. Thank you.