Success, no more noises!
New belt:
Glazed pulley surface:
Sanded down with 120 grit:
I didn't sand down the belt tensioner pulley since it isn't old. I doubt it had any time to glaze over unlike the fan pulley which is probably the original and has seen multiple belts in its lifetime.