Take the fuse out and use the meter to check the voltage at both the terminals (on the box, not on the fuse
). This'll let you know if you have voltage. Fuses often (esp. in MBs) corrode on the terminals, and may look okay when in fact they don't work when you put them in - better be safe and try some others.
I had a really tedious problem with wipers intermittently not working a while back, started checking all the bits and pieces before finally figuring the fuse was worth testing