You are not alone - I'm a proud owner of a Magnesium Brown (480) 1981 W123 300D. I must confess I didn't like the colour much when I bought the car but it has grown on me... it is certainly very typical of the time.
Recently I came across a brand new Mercedes with almost the same colour (it was ever so slightly lighter) so perhaps brown is coming back in.