Simply a bad ground at the voltage regulator could also cause this. Unbolt the regulator, clean up a few spots so there is bare metal showing. Hit with some grease, re-attach regulator and see if it still does it.

If it does, then yes, bad reg.