FastLane shows the cover as G4011-53267 for $9.25. I would only replace other parts if needed. If you did pull the housing, You'd need a new gasket where it connects to the engine, and a new bypass hose likely - much more work than necessary. If the thermostat is old, you could replace it, and in any event you should get a new thermostat o-ring.

Steve