It will come off.
I ended up hitting mine a few times with a rubber mallet to get it loose then just jimmied it loose. Once you take the pulley off nothing holds it on except the tight fit. Be sure that before you do so that you mark the relation between the pulley and the harmonic because there is a slight offset to the 5 pulley bolts that you can't really see that will only allow the harmonic and pulley to be put back one way.
Really important unless you want to spend a long time test fitting it to get it back together.