no big deal. The problem is the brake surfaces (rotors/drums) oxidize or rust over slightly. The rust makes a rough surface that grabs the pads/shoes and casues the dragging feeling.
It goes away becasue after you drive a few miles all the rust gets rubbed away and leaves a smooth surface
Not much you can do about it, but its totally normal.
