You must have a leak in either the vacuum line used to supply VAC for HVAC when the engine does not produce any like in REST, or you have a leak in the lumbar section which provides pressure. They both have reservoirs and the pump is replenishing.
Transparent (P-) vacuum
Gray (p-) lumbar
There also could be a bad check valve on the engine side.