Is it possible to polish out scoring on a cam shaft lobe?

While doing a valve adjustment, I noticed a little bit of scoring on a couple of lobes. I removed the oil squirter tube and rinsed it thoroughly with a chemical solvent. The solvent squirts out of all the little holes, so if there was an obstruction, it's now gone. The rocker pads all look fine.

Would it hurt to go over the lobes with a fine 600 grit emery board, then finish with a polishing wheel? Would the hardening on the lobe be lost? Would it make a difference? Is it better to have scratched through hardened steel, or smoothly polished steel? I don't think timing would be affected.

__________________
1982 300CD Petrol/Black Leather