I did exactly that on my W124 '94.
The MB shop wanted £1000 for a new cat, but my local shop said that it was only the heat shield rattling, so take it off.
I did, and it's done 20,000 miles with no problems.Saved a grand.
My wife wanted to spend the money I saved though.