What are you using to jump the terminals? I suggest a fairly heavy guage wire.
When you club the starter to make it start usually what is happening is the brushes are seating on the armature and making better contact. If this is the only thing that helps I would be inclined to try another starter. I understand they are a ***** to replace so you might want to talk to the rebuilder first.