I just replaced the power mirror switch on my 1994 E 320. It was damaged and original knob was destroyed. Once new switch was on, everything was fine except that the passenger side mirror will not move laterally. Since the switch is new, I have to assume the problem is elsewhere.
The switch cost $30 and it took dealer an hour to install it. Would seem to me new switch would be the place for you to start.
Terry.