Yea man, I have had to break one or two of them that i have done. They can get seized pretty tight. A new one isnt too much. If it doesnt come out by wiggling it, you may have to do this.

Try tapping around on it with a brass punch ,or somthing soft.But be careful!