Also, I just checked the vacuum on the solid brown line going into the firewall after the yellow junction and I am getting a solid and steady 21" vacuum.

When I hook the vacuum gauge up to the vacuum pump directly I get the same reading.

I am thinking my shut off valve is bad or starting to fail?

It takes a little time for the engine to turn off, but it does eventually.