Looking at the wiring diagram for the switch on holleys site I am going to guess you have a mis wire. Reason being,
1. you say the pump runs with the key on but stops when the motor is running.
Per their diagram the switch terminal
N (normally closed contact) should be wired to the starter relay (start terminal). This puts power to the pump while the engine is being started
Terminal
NO (normally open contact) should be wired to the input side of the ballast resistor or to a terminal that is hot in the run position. This puts power to the pump once the engine starts and builds oil pressure
Terminal
C is the common and hooked to the pump.
HOLLEY SWITCH INSTRUCTIONSDepending on how your relay is wired it may also be the problem. (HINT) It may be interesting to note per their digram and instructions, they do not require a relay. (HINT x 2)
A schematic or or drawing of your wiring would help tremendously. keep us posted