Querky AC / idle question!

When idling with the air conditioning off, the idle is rough, and sometimes seems as if its missing here and there, turn on the A/C, and the idle is smooth with no missing! I've looked through the threads but can only find things with the idle getting rough and even stalling when the a/c is turned on. Any help would be appreciated!