I would leave my feeler gauge in while I tightened down on the adjustor. Then once I was satisfied with its clearance I would tighten the top nut on until satisfied.

The feeler maintained a perfect clearance and the bolts didn't get too tight.