If you do take the detent lever off the transmission make sure to locate the little pin on the neutral safety switch back into the hole on the lever. Failure to do so may lead to a destroyed NSS. I did this and it turned a simple bushing replacement into an NSS swap.
The good thing about pulling the lever is you get to press the busing on the bench in a vise or c clamp.