If you're sure the idler pulley is making noise, you should go on and change it before it freezes and breaks your belt.
I've had that experience on a Ford Ranger pickup, a pretty sorry little vehicle it's true, but the basic dynamic is probably the same.
Harvey