I took the booster apart and cleaned everything and tried it out. It didnt make any difference.
But i did notice that the reason the pedal sticks down only when moving is because when the clutch pedal is pushed in it puts pressure on the bushing that the brake pedal pivots on and that bushing looks like its rusted tight and the bushing is actually turning in the pedal housing and will not let the brake pedal bushing rotate on it.
Looks like i need to pull the steering column out to pull the brake housing out