I will assume that smacking it means really a hard smack!
Also, I was going to apply some heat to increase the OD of the larger casting. Is that a good idea? I removed the ball joint rubber already and only the grease will fry. Got an extinguisher just in case. I feel that simple smacking is not enough. Unless, of course, as a rookie I don't know how hard to smack.