Try switching out the fuse with another one - even though the fuse may look o.k. sometimes it is not. I periodically take my fuses out and "rough" the ends up so they will make a good connection. You can do this with fine sandpaper or an emery board.
I know this is probably a stupid question but.... does the passenger seat move when using the switch on that side?