Is it possible your cams were replaced with those off a 4.5 engine?

Otherwise, if the clearance is >2mm difference, your looseness is alright. What is the p/n on your cams?