The brushes on the blower motor might be worn, leading to intermittant contact. It is possible to replace them only, if you can find the brushes, and refurbish the motor, but it may just be easier to replace the whole deal.

If you can expose the blower, you can jumper 12v to the motor leads and see if it will turn. If not, then that's at least one thing you know needs to be fixed.