behind that orifice that threads into the pump, there is a pressure relief and a spring. you'll most likely need a magnetic on a stick to get them out of the pump. remove the orifice (large nut) pull out the pressure relief and spring and inspect both. no need to pull the relief apart. just make sure they move in the hole and springs back in the new pump.
here is how they sit in order in the pump.
View attachment 90664
if you eliminate the valve, you will need a normal orifice and that little U shaped pipe