Your pumps are leaking and need to be replaced.
There have been some recent postings on trick to get the old one out. You may want to do a search. I personally did not find it that challenging, but my method certainly was not pretty and actually pretty crude. I just used a small set of vice grips to remove the old.