Run the engine, the servos should be helping the braking. Turn engine off, servo should still give you about 5 pumps of assistance, then the pedal goes hard.
If it doesn't then the non-return valve on the servos might be goosed.
If the assistyance is coming and going then you need to check that pump, funny noises don't sound good.