If it's a plastic/phenolic float, replace it with a brass float, I've had this issue with the plastic/phenolic floats