Sounds like the battery needs to be load tested to make sure it has enough amperage. A multimeter only reads voltage. Voltage is only "potential" to do work, the actual work is done by the amperage. Have the battery tested at a parts store before going any further.