Yes get the washers ... they are inexpensive. Yes you can do this without taking out the radiator. Just be very careful when moving the fan around that you don't hit it. You don't want to bend the soft aluminum radiator core.
Take your time. It will be fine.