Other than external mechanical binding, it does not matter what direction a steering damper is installed. A damper's sole purpose is to induce some drag into the steering and absorb rapid steering linkage impacts.

Unevenly worn tires will cause the car to pull / wander, perhaps moving them around and seeing if the problem gets better / worse is in order.