Hitler didn't invade Switzerland because he didn't need to. The Swiss, armed with any weapon, were not standing in the way of Hitler's plans. Besides, the Nazis needed a safe place to send their money.