The balancer doesn't need to come off, but it makes the job alot easier if it does. It took me a good afternoons work to change it out on my car by leaving it on. It was a couple of years ago, but I remember the bottom couple of bolts were real tricky to get out.

My car is an '85 500 SEL Euro.