From your description, it sounds like the fan bearing. I just had the serpentine belt off my M103 and the fan and clutch had no movement. If you are able to take the belt off, you can easily check all the pulleys on the front of the engine.

Good Luck.