Yeah, sounds like a gearbox bearing , mine does it too, has done for a couple of years now , I just sit on the clutch rather than let it hammer away in neutral. Or switch it off .....

__________________
'72 240D
'76 300D
'88 300sel
'40 Chev pickup , the shop hack.
'73 Monte Carlo Landau, for "Super Chevy Sunday"