Your symptoms sound like classic brake boost failure.
Your brakes will still work at their full potential - but all of the force to activate them will come from your leg, with no help from the booster.
Given the intermittent nature of the problem, it's likely you have a vacuum leak somewhere in the system as opposed to a problem with the booster itself.
Get it fixed soon!
