If the pump is the source of noise you will be able to tell by looking at and feeling of the roller once the pump is removed. I would not recommend starting the motor with the pump removed since the crankcase will be exposed to the elements. You risk getting dirt in the crankcase and slinging oil all over the engine compartment.

Have a great day,