I have the same preoblem with my car. Passenger seat goes back when pushing the adjuster forward. I thought a worn switch so I radically moved the switch in all directions.

After a couple minutes of hard irratic pressure it started acting right. I atribute this to lack of use and corrsion or oxidation on the switch pads. The more I use it the less prevelant it becomes.