Cool, got it. After messing with it for a while with a paper clip and a small allen key ( the jewelers drivers I had have to fat of a body for more torque and hit the key) I found that being delicate with it isnt the way. I finally shoved the allen key down in there past where I was going and it loosened it right up.
Now that I have it off, is there any preventative maintenance I can do before I install it to gain a couple more years out of it?