After some more searching I've determined this is the rack position sensor that would have had something to do with the EGR (which has been deleted from this engine).

Can I remove it? If I remove it by taking out the small hex head bolts will the internals of the IP be exposed, or is it simply mounted to the side?