Another way to look at a battery is it is like a fuel tank. You wouldn't replace a fuel tank if it was empty - rather you would fill it with more gas.

And with a battery which has a low charge, try charging it with a battery charger (fill it back up with electricity - if you will).