From a cold start, something in my engine compartment will rattle for the first 2,000 rpm of accleration. It shuts up after 2,000 or so RPM or when the car is warm.

I took a peek at my belt tensioner pulley and it is indeed at an approximate 2 degree angle off from the crankshaft pulley.. time for replacement? How much of a PITA is it?