There is no need to remove the old solder but you will need to add a bit of fresh electronics grade rosin core solder to the joint. Just reheating is not adequate for a good joint.