On many vehicles, the fuel pump turns on for 2-3 seconds, to pressurize the fuel rail, with the ignition key.
After that, they won't come back on until you have some oilpressure established, by cranking the engine over.
Makes sense. If you don't have oilpressure, you DON'T want fuel.