Update:

I did change the rear pads. They were chunked a bit. The new pads seemed to improve the bite.
I'm still getting the occasional issue where I use up the vacuum and the pedal gets hard. I have a vacuum pump but I wonder if I should also plumb in a small tank for vacuum reserve. I already have it so there would be no cost to try it.