I can't remember if it was off or not when I tried checking it (also when it spewed oil all over everything) but I am pretty sure it shouldn't spew oil like a geyser regardless of whether or not it is on. I definately could tell there was built up pressure in the valve cover as it depressurized when i first removed the kinked tube to the turbo.

I know I shouldn't have used "random" o-rings, but they are oil and heat rated, and they were snug, just not wide enough to probably make as good a seal as they should be making. I'll check to make sure they didn't get sucked in somewhere (that would explain a lot) when I get home.