Get a few credit cards that have $1000 limits on them with %2.9 APR. Max them out, and pay down the rest, double the payments if you can. If you bite the bullet for a little while, you just have some low interest credit cards to pay off, and the SVT is yours, free and clear!
That way you don't have to refinance (points cost $$$) and you just raised your credit standing.
Or, see how much you can get an unsecured loan for and do the same thing. Maybe even a home improvement loan.
There are lots of ways to do this, but in the end, you're probably better off making larger payments to the original loan.
-Chris