Go for it!
It'll probably be a PITA to get everything to work and look good, but the benefits would definately worth it.
Now, if you could only figure out some type of system to work with one of those memory settings for seats/mirrors, you'd really be cooking!!!
What type of tweets are you planning on using? They do make some out there that already swivel in their mounts, which might make 'em easier to work with.