It was a leaking vacuum booster. Do you hear any air escaping or a whooshing sound as you apply the brakes? Do you get good "pedal" after driving for a few minutes then as you brake it gets progressively worse?

Other than that it's probably the master cylinder-not something to let go without immediate fix.

J. Boggs