How to remove 107 4.5 camshaft woodruff key?

I dial indicated after new timing chain and guides and my Right camshaft is off by 8 degrees on the crank. I have a 4 degree offset key but I cant seem to get the old straight key out of the camshaft. Are there any tricks. Do I have to remove the spacer behind the cam sprocket first?

thanks again,
jmdunn