If it pushes water out the overflow below the boiling point you have the radiator too full or something else is pressurizing the system (blown head gasket).

Do you have a "dangling disc" radiator cap?