Ball bearings generally don't get play until they fall apart from a failed cage. This will be visible once the seal is removed.

Is the yoke nut tight? It will be staked on but fretting wear will let the yoke some loose on the shaft. After a time the splines wear and drive will be lost.