Could be something as minor as a bent exhaust heat shield (can bend it off whatever it's rattling on) to as bad as gear grind. I'd say it's a bent heat shield, despite it not rattling when in neutral.

Tranny mount loose?

Someone else with more experience will chime in, I thought I'd tell you some pointers so youre not stuck waiting.