What kind of master cylinder do you have?
Drum brake master cylinders have a residual pressure valve that can cause drag.