No idea about laws in VA, but in CA recording the conversation requires formal notification, though it's possible they slipped something in the "employee handbook".
Still, I doubt your boss has TIME to listen through tens of hours of audio tape just to catch you at that little comment. I think it's coincidence.