I have this issue as well, except I have a vacuum canister and a vacuum pump. It is worse at colder ambient temperatures. At 70F it is ok. At 30F it doesn’t have power assist for a mile or two of driving. I’ve verified the pump is working as intended, my next step was to put a vacuum gauge at the line going to the booster.

I have a hunch it’s the booster not sealing.