I'll bet the square seal was actually the original round o-ring that has flattened over time. Heat and exposure to hydrocarbons in the oil do bad things to rubber over time.

The seal didn't look like an o-ring, so nobody thought to remove it. The second picture is the way everything should look - your leaks should be a thing of the past.