The blasted things requires more force than we would thing reasonable. Yank like heck from one side to remove. Insert one side, have helper hold in place and pound with rubber hammer (actually, use something like a 2x2 up against the base of the mirror and hit the wood with the rubber hammer).