I've had both and didn't notice a performance difference when I put the cat back on and took the off-road y off. If it's a SHO-Shop cat, expect it to crumble earlier than it should like mine did. It'll be a bit more droney with the off-road on too btw.
