I think you can replace the clip without removing the visor from the car.
Do what Scott says about partially extracting the rod, with the visor in place.