It's called a check strap and yes, the door cover needs to be removed for this operation. There's a page on this web site that illustrates this procedure:
W124 check strap replacement
It's a common problem on W124's. I had to repair the check strap on mine last year. It wasn't easy to repair. Most people just order a new one ($35?) from Fastlane.