I've had my tensioner out several times, at least six times, and have never had any problem related with it. I just unscrew it and lay it off to the side and then reinstall and tighten. My crush washer has never been replaced when doing this and forms a perfect seal every time. Maybe all that might be necessary for you is to tighten it, as it may just be loose, or looser than than should be!