Got it, finally. Never did manage to get the screw to loosen with a screw driver, so I rotated the head with a pair of vise grips while gently applying upward pressure. About three turns like that and it gave enough that I could remove it with my fingers. Swearing a bit helped.

Now to get a replacement blower regulator and put it all back together.