Could the armature be worse than expected or could the blower motor itself just be worn out?
+++++++++++++++++++++++++++++++++++++++++++++
Another possible cause is that the contacts behind your dash control fan button/s may not be making good contact. I am pretty sure you can take the dash unit out and clean and/or re-solder the contacts. Or if that is the problem you can replace the entire unit but that is expensive.