I would say it depends on what it is swapped with. You could make the same argument for replacing any SVT specific item... including body-kits, suspension, wheels, exhaust, interior parts... anything.
In fact, I think many of things are more "SVT" than the engine.