The ball joint bolt required a bit more hammering than I would have liked, but finally got it out. I also need two sets of spring compressors to get the spring compressed, but maybe the one I rented (from Canadian Tire) just wasn't long enough.
Here's a picture of the the broken spring, after I had cut some of it off and twisted it back into position so I could drive home. You can see how it slipped off the spring pad.
Here is the broken piece, along with the piece I cut off, I had to cut the broken piece in two to get it out, but you can clearly see the break vs the cut.
Finally the damage to the rim, might be hard to see in this picture. But there is a gouge around the outer edge of the rim. Lucky didn't damage the tire.