Unless the ambient dew point is below 25°F, which is nearly impossible on a hot day. So yes, the evaporator would quickly be a block of ice. The thermometer needs to be calibrated. Use a glass of water filled with ice cubes to calibrate it at 32°F.