Correct about vac. It should bleed down to zero vac when you hit the accelerator and shift smoothly with zero vac. Only needs vac for the downshifts which will be clunky otherwise.

Your problems do not seem to be vac related.