I wouldn't leave the bolt out.
Did you tighten the other bolts up yet? Start all the bolts before you tighten up any of them. If the y-pipe gives you more room I would take it off, but the bolts can be rusted on there, be warned. Use lots of penetrating oil. Good luck
