Normally that's a sign of a master cylinder bleeding by. Time to get a new one or rebuild the one you have.