jr:

Have a close look at the connection of the 3-4 lever to the shaft that enters the trans case.
There is a bolt that retains the lever to the shaft. If it has backed out the lever will swing freely on the shaft, per your description.