Im no expert, but even though you have checked the fuse and it appears to be fine, I would still go ahead and replace them just to be positive. Having 2 windows go out at the same time makes me think fuse.