It's really uncommon but I've run into a couple instances where the booster was failing and slightly engaging the brakes.

Start by cracking a bleeder to see if there's hydraulic pressure causing the drag. If so, it could be the booster. When the brakes drag again, loosen the master nuts a couple turns and see if the drag goes away. Note, the pedal will have extra travel so be careful.