remove the caliper to replace the pads. Look down "edgewise" at the brake pad. The "slot" that you are looking down into should be big enough to pull the pad straight out - like away from the center of the wheel. There should be something holding the pads in against this outer edge you are looking down into. Unless the rotor is worn out you really should be able to do this job without removing the caliper.
Jim