What you describe could very well be a vacuum pod on the fresh air door not operating correctly. I would check the refrigerant level with manifold guages and a thermometer. If it appears to be somewhere near properly charged, your problem is then almost definitely a problem with the fresh air door. In really hot weather it should not be allowing fresh air until the cabin is cooled down really well.

Good luck,