It won't damage your car but it might be unsafe if you have to get out of your own way. You can downshift using the shift lever if the transmission doesn't respond to the pedal. It should downshift on its own as you slow down.

Sixto
87 300D