You should always get bare metal covered immediately.

3M makes this sanding pen thing that will get down into the scratch, then some anti-rust primer and paint to cover. (even just temporarily)

If rust gets a grip you will have to sand down and feather the whole side of the car to re-paint.

"Those who cannot remember the past are condemned to repeat it" -George Santayana