Nah man, brakes rust quite easily when exposed to moisture. My brakes rust every time I wash the car. It gets scraped off after a few stops. No big deal.
If you are talking about discoloration on your brake calipers or around the circumference of the discs, you can still clean that up with a good old fashioned session at the sand blaster.