For pedal feel, there is a noticable difference between the two. If everything else is the same, expect the Se rotors vs. the SVT rotors, you will notice a little more deceleration for a given amount of force applied to the pedal, or amount of travel in the pedal.
Most of the time, people put new pads in at the same time, and have to rebed the rotors, and conditions change slightly, so the difference can be either masked or exaggerated in the perception of the driver.
Fade should be better for the larger SVT rotors, as the temperature in the rotors will be a little slower to rise because of the additional mass, but pad material has such a huge affect on fade that with a poor pad for track use, the fade may be just as bad with either rotor size.