[Back in Black]

Don't even THINK about starting it or any more work until you have at least one right there with the safety pin pulled, and you ready to hose the engine down. The ss line should not spark ! It sounds like maybe a ground problem, is the motor properly grounded to the frame? Is the fuel pump grounded to the motor? Or is it grounded to the frame? (If no to these questions, then be sure to properly ground, if yes, then clean your ground connections and use some vaseline, etc.. to keep corrosion at bay) After dealing with the ground questions, ....
Maybe you have shorted the fuel pump or have wires crossed somewhere, so that the fuel pump only operates correctly when you turn the key off (I assume this is a new build up or you have recently added the electrical fuel pump) I would think you may have the pump wired wrongly, if it is new? It should have it's own circuit, not daisy chained off of the starter wiring, for instance.

I also assumed that there is no fuel pressure when the motor turns over ? Anf that you mean that the motor does not turn over at all? This *clicking* would indicate wiring error or a shorted part ? and that the starter is in the wiring error loop maybe.

Do not EVER remove the fuel line if there is any chance it is still under pressure, especially on a hot motor, or if the battery is still attached !!

Maybe others have hands on experience with this problem.