You also want to check to see if one of the points of the nearby main cap bolt is not interfering with the pump socket tower, preventing it from seating properly. I've seen it more than once and rounding the offending point of the bolt head fixed it right quick.

I notice a big gouge on the flat side of the pump.

Double check that.