If it's not a tire or dragging brake, I think some frame tramming is in order. A front end accident could change the steering axis inclination. This is the angle of the steering axis viewed from the front. The caster angle is the angle of the steering axis viewed from the side.

On most cars the steering angle axis inclination is fixed and not adjustable, but could be affected by accident damage.

One check is that with the caster and camber set equal on both sides, the measured camber angle with the wheels at extreme left and right lock should be a mirror image. If not, the steering axis inclination could be different side to side.

Duke