I got busy today and removed the pump and found no weak spots on the gasket between pump and engine so I figured I might as well take a closer look at the pump itself.
Tinkered around a bit and got the front cover off from the pump and then put everything back together with some added loctite.
Fired it back up and went for a spin and there aren't any signs of leakage so far.