Power seat switch '90 300 SE

My passenger power seat control switch doesn't work in the forward direction. The motors are OK because pressing the memory button causes the seat to move forward...and all of the other directions work ok when I manually push the switch in all of the other directions.

I'm thinking the forward contacts on the switch are dirty. How do I go about getting to the inside (or back) of the switch? The switch assembly is in the middle of a wood grain trim piece. Does the whole door panel need to come off, or is there a way to get the woodgrain piece off?

Am I even barking up the right tree here? (is it likely to be something something other than the switch?

Thanks, folks