i had one of those rubber deals on my car, i haven't even been driving the thing really, and still it was dry rotted/cracked after a year or two.
the housing of the water pump was kinda corroded and leaky at that nipple area so i just replaced the pump.
bought a PRW pump and it was tapped so i could put a plug in the heater hose outlet. no more worries about that rubber cap...