As long as the surface is reconditioned properly there is no increased concerns of wear. Good to be concerned about the parts you install, not so good to be paranoid.
Maxing out pre turbo is.. well.. useless? You will always be limited by head flow and without positive manifold pressure im sure you have already ran up against that wall.
Ps i have / or have seen flattened cam lobes on new, aftermarket, and reground cams.