I don't know of a reason why not removing the ignition switch would have harmed it. The biggest danger, seems like, would have been to the side of the heater box, but you did lower the column so that should have been OK.

Did you get this figured out?

__________________
2012 E350
2006 Callaway SC560