Definitely battery first. The voltage regulator hasn't been replaced since I've owned the car (17 yrs), but it was replaced during the restoration so its not 40 years old either.