Yes, the fuel pump will turn on for about 2-3 seconds each time the ignition is switched on. Then it will turn off and wait until the starter is energized to begin running continuously.
So, you can switch the ignition off and on repeatedly and should hear the pump buzzing each time.

DG