The noise was due to slightly too long lug bolts. Interestingly enough, these were the same OEM bolts used before the winter but I guess a few are a bit too long (not by much) therefore the noise.

I took off the left rear wheel and saw the lug bolts had a little bit of shinny marks. I used a file to smooth them out and the noise is gone now.