There are quite a few people who have mounted a 8" sub under the deck. There is also an installation of an enclosure under there as well. So, it can definitely be done.
What's pros\cons of mouning 8" under rear shelf against something huge in a trunk ?
I thinkg with 8" in a opening you should get more detailed bass.