You have a vacuum leak of some description. It is possible that the EGR valve is the source of the leak, not the vacuum line to the valve, but the pintle portion of the valve that allows exhaust gas into the intake.

Connect a vacuum gauge to confirm that there is a vacuum leak, and if so, find it.

My $0.02,