I ended up loosening them until they were right where I could feel them about to come out. Managed to get all of the belts on and tightened up from there.

This job isn't hard, but I did find it to be a PITA. It'll probably be much easier the next time I do it.