Hello,
If the battery is old I'd replace it.
Had the same problem on my wifes Camry,,,replaced the battery and it was good to go. Voltage seemed good but it must have had a bad cell (low amperage).
An auto parts store should be able to test it for you, I hate replacing parts that I don't need to.
Regards
Jeff