I used both. thin layer of rtv on both sides of the gasket.

don't forget the bypass hose while you are in there.

the pipe for the heater hose came with my wp, so I didn't have to waste time figuring how to get it out of the old one.

I can't remember if the bypass nipple was cast into the new one or I had to put it in, but it came with the wp too.