The transmission is worn, needs a rebuild. Fourth gear places the highest load on the hydraulics because both clutch packs need to engage. So internal leakage will initially show as a problem engaging fourth.