Check:

1) Idler arm. Even a slight amount of play here can cause big problems
2) Steering dampener (if the car has one)


Does the problem sometimes get bad all of a sudden when you hit a bump at speed? If so, see above.

3) Less likely, but possible: Warped brake rotor and a caliper that doesn't release all the way.

Good Luck!