I don't use the AC - ever - and it's significant wieght. It's probably worth around 0.2 sec on an autocross course. It's almost certainly not seat-of-the-pants noticeable, but it's a real gain. 40+ lbs off the front end of a car that's already front heavy is huge.
