Yes, voltage output sounds good. I would place a heavy bet being the battery is the culprit.

Most places that sell batteries will test them for free. Just remove it and haul it into your favorite battery supplier.

Good luck,