You have a worn bushing on the trans selector arm/link.
Do a search .. short $$$ and a DIyer job...