[wolf k]

Crank it in (clockwise) to raise pressure, a few turns should do it. That spacer that you mention simply eliminates the spring and keeps the relief valve closed in the pump, thus, allowing all regulating to be handled by your Holley regulator. Cranking the screw all the way in would probably accomplish the same thing.